20:04:36 Started by timer 20:04:36 Running as SYSTEM 20:04:36 [EnvInject] - Loading node environment variables. 20:04:36 Building remotely on prd-centos8-builder-2c-4g-2405 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 20:04:36 [ssh-agent] Looking for ssh-agent implementation... 20:04:36 $ ssh-agent 20:04:36 SSH_AUTH_SOCK=/tmp/ssh-h1styPGGDWso/agent.5167 20:04:36 SSH_AGENT_PID=5169 20:04:36 [ssh-agent] Started. 20:04:37 Running ssh-add (command line suppressed) 20:04:37 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_3955289362643143996.key (jenkins-ssh) 20:04:37 [ssh-agent] Using credentials jenkins (jenkins) 20:04:37 The recommended git tool is: NONE 20:04:39 using credential jenkins 20:04:39 Wiping out workspace first. 20:04:39 Cloning the remote Git repository 20:04:39 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 20:04:39 > git init /w/workspace/ci-management-openstack-cron # timeout=10 20:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 20:04:39 > git --version # timeout=10 20:04:39 > git --version # 'git version 2.43.0' 20:04:39 using GIT_SSH to set credentials jenkins 20:04:39 [INFO] Currently running in a labeled security context 20:04:39 [INFO] Currently SELinux is 'enforcing' on the host 20:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh13664470746566862104.key 20:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 20:04:43 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 20:04:43 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 20:04:43 Avoid second fetch 20:04:43 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 20:04:43 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 20:04:43 > git config core.sparsecheckout # timeout=10 20:04:43 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 20:04:44 Commit message: "CI: Update github2gerrit caller to v2.4.4" 20:04:44 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 20:04:44 > git remote # timeout=10 20:04:44 > git submodule init # timeout=10 20:04:44 > git submodule sync # timeout=10 20:04:44 > git config --get remote.origin.url # timeout=10 20:04:44 > git submodule init # timeout=10 20:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 20:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 20:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 20:04:44 > git config --get submodule.global-jjb.url # timeout=10 20:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 20:04:44 > git submodule update --init --recursive packer/common-packer # timeout=10 20:04:48 > git submodule update --init --recursive global-jjb # timeout=10 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 20:04:59 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 20:04:59 provisioning config files... 20:04:59 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 20:04:59 copy managed file [npmrc] to file:/home/jenkins/.npmrc 20:04:59 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 20:04:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins766813677808715564.sh 20:04:59 ---> python-tools-install.sh 20:04:59 Setup pyenv: 20:04:59 system 20:04:59 * 3.8.13 (set by /opt/pyenv/version) 20:04:59 * 3.9.13 (set by /opt/pyenv/version) 20:04:59 * 3.10.6 (set by /opt/pyenv/version) 20:05:04 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-uMKe 20:05:04 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 20:05:04 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:05:15 lf-activate-venv(): INFO: Installing additional packages: lftools 20:05:51 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:05:51 Generating Requirements File 20:06:34 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 20:06:34 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 20:06:34 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 20:06:34 Python 3.10.6 20:06:34 pip 26.3 from /tmp/venv-uMKe/lib/python3.10/site-packages/pip (python 3.10) 20:06:35 aiohappyeyeballs==2.7.1 20:06:35 aiohttp==3.14.5 20:06:35 aiosignal==1.4.0 20:06:35 appdirs==1.4.4 20:06:35 argcomplete==3.7.2 20:06:35 aspy.yaml==1.3.0 20:06:35 async-timeout==5.0.1 20:06:35 attrs==26.1.0 20:06:35 autopage==0.6.0 20:06:35 backports.strenum==1.3.1 20:06:35 beautifulsoup4==4.15.0 20:06:35 boto3==1.43.126 20:06:35 botocore==1.43.126 20:06:35 bs4==0.0.2 20:06:35 certifi==2026.10.23 20:06:35 cffi==2.1.1 20:06:35 cfgv==3.5.0 20:06:35 chardet==7.7.0 20:06:35 charset-normalizer==3.5.2 20:06:35 click==8.5.1 20:06:35 cliff==4.14.0 20:06:35 cmd2==3.5.1 20:06:35 cryptography==3.3.2 20:06:35 debtcollector==3.1.0 20:06:35 decorator==5.3.1 20:06:35 defusedxml==0.7.1 20:06:35 Deprecated==1.3.1 20:06:35 distlib==0.4.4 20:06:35 dnspython==2.8.0 20:06:35 docker==7.2.0 20:06:35 dogpile.cache==1.5.0 20:06:35 durationpy==0.11 20:06:35 email-validator==2.3.0 20:06:35 filelock==4.1.0 20:06:35 frozenlist==1.8.0 20:06:35 future==1.0.0 20:06:35 gitdb==4.0.12 20:06:35 GitPython==3.2.1 20:06:35 httplib2==0.30.2 20:06:35 identify==2.6.20 20:06:35 idna==3.20 20:06:35 importlib-resources==1.5.0 20:06:35 iso8601==2.1.0 20:06:35 Jinja2==3.1.6 20:06:35 jmespath==1.1.0 20:06:35 jsonpatch==1.45 20:06:35 jsonpointer==3.10 20:06:35 jsonschema==4.26.0 20:06:35 jsonschema-specifications==2025.9.1 20:06:35 keystoneauth1==5.14.0 20:06:35 kubernetes==36.0.3 20:06:35 lftools==0.37.26 20:06:35 lxml==6.1.3 20:06:35 markdown-it-py==4.2.0 20:06:35 MarkupSafe==3.0.4 20:06:35 mdurl==0.1.2 20:06:35 msgpack==1.2.4 20:06:35 multi_key_dict==2.0.4 20:06:35 multidict==7.1.0 20:06:35 munch==4.0.0 20:06:35 netaddr==1.3.0 20:06:35 niet==1.4.2 20:06:35 nodeenv==1.12.0 20:06:35 oauth2client==4.1.3 20:06:35 oauthlib==4.0.1 20:06:35 openstacksdk==4.13.0 20:06:35 os-service-types==1.8.2 20:06:35 osc-lib==4.6.0 20:06:35 oslo.config==10.4.0 20:06:35 oslo.context==6.4.0 20:06:35 oslo.i18n==6.8.0 20:06:35 oslo.log==8.2.0 20:06:35 oslo.serialization==5.10.0 20:06:35 oslo.utils==10.1.1 20:06:35 packaging==26.3 20:06:35 pbr==7.1.3 20:06:35 platformdirs==4.12.4 20:06:35 prettytable==3.18.0 20:06:35 propcache==0.5.4 20:06:35 psutil==7.2.2 20:06:35 pyasn1==0.6.5 20:06:35 pyasn1_modules==0.4.2 20:06:35 pycparser==3.11 20:06:35 pygerrit2==2.0.15 20:06:35 PyGithub==2.10.0 20:06:35 Pygments==2.21.0 20:06:35 PyJWT==2.15.1 20:06:35 PyNaCl==1.6.2 20:06:35 pyparsing==2.4.7 20:06:35 pyperclip==1.11.0 20:06:35 pyrsistent==0.20.0 20:06:35 python-cinderclient==9.9.0 20:06:35 python-dateutil==3.0.0 20:06:35 python-discovery==1.9.5 20:06:35 python-heatclient==5.2.0 20:06:35 python-jenkins==1.8.3 20:06:35 python-keystoneclient==6.0.0 20:06:35 python-magnumclient==4.11.0 20:06:35 python-openstackclient==10.0.0 20:06:35 python-swiftclient==4.11.0 20:06:35 PyYAML==6.0.3 20:06:35 referencing==0.37.0 20:06:35 requests==2.34.2 20:06:35 requests-oauthlib==2.0.0 20:06:35 rfc3986==2.0.0 20:06:35 rich==15.0.0 20:06:35 rich-argparse==1.8.0 20:06:35 rpds-py==0.30.0 20:06:35 rsa==4.9.1 20:06:35 ruamel.yaml==0.19.1 20:06:35 ruamel.yaml.clib==0.2.15 20:06:35 s3transfer==0.19.3 20:06:35 simplejson==4.2.0 20:06:35 six==1.17.0 20:06:35 smmap==5.0.3 20:06:35 soupsieve==2.10 20:06:35 stevedore==5.8.0 20:06:35 tabulate==0.10.0 20:06:35 toml==0.10.2 20:06:35 tomlkit==0.15.2 20:06:35 tqdm==4.70.1 20:06:35 typing_extensions==4.16.0 20:06:35 tzdata==2026.6 20:06:35 urllib3==1.26.20 20:06:35 virtualenv==21.15.6 20:06:35 wcwidth==0.9.4 20:06:35 websocket-client==1.9.2 20:06:35 wrapt==2.5.2 20:06:35 xdg==6.0.0 20:06:35 xmltodict==1.0.4 20:06:35 yarl==1.25.1 20:06:35 yq==4.4.5 20:06:35 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins7688564938699262525.sh 20:06:35 ---> uv-install.sh 20:06:35 Installing uv/uvx (latest) using shell installer 20:06:42 2026-11-10 20:06:42 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-6xFEUn.sh" [1] 20:06:42 downloading uv 0.13.7 x86_64-unknown-linux-gnu 20:06:46 installing to /home/jenkins/.local/bin 20:06:46 uv 20:06:46 uvx 20:06:46 everything's installed! 20:06:46 ---> Validating uv/uvx install 20:06:46 uvx 0.13.7 (x86_64-unknown-linux-gnu) 20:06:46 [EnvInject] - Injecting environment variables from a build step. 20:06:46 [EnvInject] - Injecting as environment variables the properties content 20:06:46 OS_CLOUD=vex 20:06:46 20:06:46 [EnvInject] - Variables injected successfully. 20:06:46 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:06:46 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:06:46 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6980254442280354068.sh 20:06:46 ---> Orphaned k8s clusters 20:06:46 Setup pyenv: 20:06:46 system 20:06:46 3.8.13 20:06:46 3.9.13 20:06:46 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:06:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:06:46 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:06:51 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 20:07:17 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 20:07:17 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 20:07:18 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:07:28 -----> Delete orphaned cluster 20:07:28 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:07:28 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:07:28 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins758825628623594665.sh 20:07:28 ---> Orphaned stacks 20:07:28 Setup pyenv: 20:07:28 system 20:07:28 3.8.13 20:07:28 3.9.13 20:07:28 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:07:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:07:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:07:34 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 20:08:05 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:08:05 + mapfile -t OS_COE_CLUSTERS_ID 20:08:05 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 20:08:05 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 20:08:05 ++ awk '{print $1}' 20:08:15 + echo '-----> Active clusters -> stacks' 20:08:15 -----> Active clusters -> stacks 20:08:15 + OS_COE_STACKS=() 20:08:15 + [[ 0 -gt 0 ]] 20:08:15 + mapfile -t OS_STACKS 20:08:15 ++ awk '{print $1}' 20:08:15 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 20:08:23 + echo '-----> Active stacks' 20:08:23 -----> Active stacks 20:08:23 + echo '-----> Delete orphaned stacks' 20:08:23 -----> Delete orphaned stacks 20:08:23 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 20:08:23 Run condition [Boolean condition] enabling perform for step [Execute shell] 20:08:23 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins6252450511604696552.sh 20:08:24 ---> Orphaned servers 20:08:24 Setup pyenv: 20:08:24 system 20:08:24 3.8.13 20:08:24 3.9.13 20:08:24 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:08:24 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:08:24 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:08:29 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 20:11:06 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 20:11:06 20:11:08 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 20:14:59 Build timed out (after 10 minutes). Marking the build as failed. 20:14:59 $ ssh-agent -k 20:14:59 unset SSH_AUTH_SOCK; 20:14:59 unset SSH_AGENT_PID; 20:14:59 echo Agent pid 5169 killed; 20:14:59 [ssh-agent] Stopped. 20:14:59 Build was aborted 20:14:59 [PostBuildScript] - [INFO] Executing post build scripts. 20:14:59 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17545093079332372322.sh 20:14:59 ---> sysstat.sh 20:14:59 /home/jenkins/lf-env.sh: line 73: 6632 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 20:14:59 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 20:14:59 /tmp/jenkins6252450511604696552.sh: line 67: openstack: command not found 20:14:59 -----> Active servers 20:14:59 -----> Delete orphaned servers 20:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16478376693574010524.sh 20:15:00 ---> package-listing.sh 20:15:00 ++ facter osfamily 20:15:00 ++ tr '[:upper:]' '[:lower:]' 20:15:00 + OS_FAMILY=redhat 20:15:00 + workspace=/w/workspace/ci-management-openstack-cron 20:15:00 + START_PACKAGES=/tmp/packages_start.txt 20:15:00 + END_PACKAGES=/tmp/packages_end.txt 20:15:00 + DIFF_PACKAGES=/tmp/packages_diff.txt 20:15:00 + PACKAGES=/tmp/packages_start.txt 20:15:00 + '[' /w/workspace/ci-management-openstack-cron ']' 20:15:00 + PACKAGES=/tmp/packages_end.txt 20:15:00 + case "${OS_FAMILY}" in 20:15:00 + rpm -qa 20:15:00 + sort 20:15:08 + '[' -f /tmp/packages_start.txt ']' 20:15:08 + '[' -f /tmp/packages_end.txt ']' 20:15:08 + diff /tmp/packages_start.txt /tmp/packages_end.txt 20:15:08 + '[' /w/workspace/ci-management-openstack-cron ']' 20:15:08 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 20:15:08 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 20:15:08 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4840094972766999907.sh 20:15:08 ---> capture-instance-metadata.sh 20:15:08 Setup pyenv: 20:15:08 system 20:15:08 3.8.13 20:15:08 3.9.13 20:15:08 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:15:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:15:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:15:12 lf-activate-venv(): INFO: Installing additional packages: lftools 20:15:28 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:15:28 INFO: Running in OpenStack, capturing instance metadata 20:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18337431317520136413.sh 20:15:28 provisioning config files... 20:15:28 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config6557816829840870631tmp 20:15:28 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 20:15:28 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 20:15:28 [EnvInject] - Injecting environment variables from a build step. 20:15:28 [EnvInject] - Injecting as environment variables the properties content 20:15:28 SERVER_ID=logs 20:15:28 20:15:28 [EnvInject] - Variables injected successfully. 20:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5262228828575006677.sh 20:15:28 ---> create-netrc.sh 20:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16697356107698174255.sh 20:15:28 ---> python-tools-install.sh 20:15:28 Setup pyenv: 20:15:29 system 20:15:29 3.8.13 20:15:29 3.9.13 20:15:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:15:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:15:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:15:34 lf-activate-venv(): INFO: Installing additional packages: lftools 20:15:53 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:15:53 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins8579115269341790789.sh 20:15:53 ---> uv-install.sh 20:15:53 uv 0.13.7 is already installed 20:15:53 uvx 0.13.7 (x86_64-unknown-linux-gnu) 20:15:53 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13443589634302023687.sh 20:15:53 ---> sudo-logs.sh 20:15:53 Archiving 'sudo' log.. 20:15:53 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1883144942645742322.sh 20:15:53 ---> job-cost.sh 20:15:53 INFO: Activating Python virtual environment... 20:15:53 Setup pyenv: 20:15:53 system 20:15:53 3.8.13 20:15:53 3.9.13 20:15:53 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:15:54 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:15:54 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:15:59 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 20:16:12 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:16:12 INFO: No stack-cost file found 20:16:12 INFO: Instance uptime: 754s 20:16:12 INFO: Fetching instance metadata (attempt 1 of 3)... 20:16:12 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 20:16:13 INFO: Successfully fetched instance metadata 20:16:13 INFO: Instance type: v3-starter-2 20:16:13 INFO: Retrieving pricing info for: v3-starter-2 20:16:13 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 20:16:13 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=754 20:16:14 INFO: Successfully fetched Vexxhost pricing API 20:16:14 INFO: Retrieved cost: 0.02 20:16:14 INFO: Retrieved resource: v3-starter-2 20:16:14 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 20:16:14 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 20:16:14 INFO: Successfully archived job cost data 20:16:14 DEBUG: Cost data: ci-management-openstack-cron,63753,2026-11-10 20:16:14,v3-starter-2,754,0.02,0.00,FAILURE 20:16:14 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16228857669736864436.sh 20:16:14 ---> logs-deploy.sh 20:16:14 Setup pyenv: 20:16:14 system 20:16:14 3.8.13 20:16:14 3.9.13 20:16:14 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 20:16:14 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uMKe from file:/tmp/.os_lf_venv 20:16:14 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 20:16:19 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 20:16:35 lf-activate-venv(): INFO: Adding /tmp/venv-uMKe/bin to PATH 20:16:35 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63753 20:16:35 INFO: archiving workspace using pattern(s): 20:16:40 Archives upload complete. 20:16:41 INFO: archiving logs to Nexus 20:16:42 ---> uname -a: 20:16:42 Linux prd-centos8-builder-2c-4g-2405.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 20:16:42 20:16:42 20:16:42 ---> lscpu: 20:16:42 Architecture: x86_64 20:16:42 CPU op-mode(s): 32-bit, 64-bit 20:16:42 Byte Order: Little Endian 20:16:42 CPU(s): 2 20:16:42 On-line CPU(s) list: 0,1 20:16:42 Thread(s) per core: 1 20:16:42 Core(s) per socket: 1 20:16:42 Socket(s): 2 20:16:42 NUMA node(s): 1 20:16:42 Vendor ID: AuthenticAMD 20:16:42 CPU family: 23 20:16:42 Model: 49 20:16:42 Model name: AMD EPYC-Rome Processor 20:16:42 Stepping: 0 20:16:42 CPU MHz: 2799.998 20:16:42 BogoMIPS: 5599.99 20:16:42 Virtualization: AMD-V 20:16:42 Hypervisor vendor: KVM 20:16:42 Virtualization type: full 20:16:42 L1d cache: 32K 20:16:42 L1i cache: 32K 20:16:42 L2 cache: 512K 20:16:42 L3 cache: 16384K 20:16:42 NUMA node0 CPU(s): 0,1 20:16:42 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 20:16:42 20:16:42 20:16:42 ---> nproc: 20:16:42 2 20:16:42 20:16:42 20:16:42 ---> df -h: 20:16:42 Filesystem Size Used Avail Use% Mounted on 20:16:42 devtmpfs 1.8G 0 1.8G 0% /dev 20:16:42 tmpfs 1.8G 0 1.8G 0% /dev/shm 20:16:42 tmpfs 1.8G 17M 1.8G 1% /run 20:16:42 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 20:16:42 /dev/vda1 20G 15G 5.4G 74% / 20:16:42 tmpfs 367M 0 367M 0% /run/user/1001 20:16:42 20:16:42 20:16:42 ---> free -m: 20:16:42 total used free shared buff/cache available 20:16:42 Mem: 3665 464 1160 17 2041 2902 20:16:42 Swap: 1023 0 1023 20:16:42 20:16:42 20:16:42 ---> ip addr: 20:16:42 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 20:16:42 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 20:16:42 inet 127.0.0.1/8 scope host lo 20:16:42 valid_lft forever preferred_lft forever 20:16:42 inet6 ::1/128 scope host 20:16:42 valid_lft forever preferred_lft forever 20:16:42 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 20:16:42 link/ether fa:16:3e:97:08:02 brd ff:ff:ff:ff:ff:ff 20:16:42 altname enp0s3 20:16:42 altname ens3 20:16:42 inet 10.32.6.58/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 20:16:42 valid_lft 85648sec preferred_lft 85648sec 20:16:42 inet6 fe80::f816:3eff:fe97:802/64 scope link 20:16:42 valid_lft forever preferred_lft forever 20:16:42 20:16:42 20:16:42 ---> sar -b -r -n DEV: 20:16:42 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/10/2026 _x86_64_ (2 CPU) 20:16:42 20:16:42 20:03:46 LINUX RESTART (2 CPU) 20:16:42 20:16:42 08:05:01 PM tps rtps wtps bread/s bwrtn/s 20:16:42 08:06:01 PM 50.07 0.87 49.21 55.59 5184.20 20:16:42 08:07:01 PM 64.36 0.70 63.66 201.53 11030.86 20:16:42 08:08:01 PM 38.64 0.50 38.14 60.65 10205.86 20:16:42 08:09:01 PM 46.03 0.18 45.85 30.26 27395.95 20:16:42 08:10:01 PM 114.64 1.38 113.26 245.21 164104.73 20:16:42 08:11:01 PM 127.49 4.16 123.32 386.34 171829.62 20:16:42 08:12:01 PM 71.54 3.65 67.89 594.30 22817.95 20:16:42 08:13:01 PM 82.74 0.08 82.66 2.67 2161.20 20:16:42 08:14:01 PM 75.77 0.03 75.74 1.07 2021.40 20:16:42 08:15:01 PM 104.15 27.59 76.56 2673.11 2035.60 20:16:42 08:16:02 PM 89.10 65.54 23.56 5509.35 1317.03 20:16:42 Average: 78.60 9.52 69.08 887.22 38197.08 20:16:42 20:16:42 08:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 20:16:42 08:06:01 PM 1406744 3053328 2346932 62.52 2104 1815508 579632 12.07 136576 1923484 137976 20:16:42 08:07:01 PM 1063360 2973748 2690316 71.67 2104 2069940 626948 13.06 139060 2225012 113148 20:16:42 08:08:01 PM 713904 2852564 3039772 80.98 2104 2293816 740756 15.43 160668 2538340 148352 20:16:42 08:09:01 PM 139072 2877532 3614604 96.30 2104 2897152 719376 14.98 190516 3093000 266940 20:16:42 08:10:01 PM 155400 2842096 3598276 95.86 2104 2839872 777240 16.18 243708 3033732 177492 20:16:42 08:11:01 PM 126940 2812676 3626736 96.62 2104 2831924 830792 17.30 291436 3038776 240288 20:16:42 08:12:01 PM 1563992 2933100 2189684 58.33 2104 1516988 716440 14.92 187696 1705780 3668 20:16:42 08:13:01 PM 1500496 2892848 2253180 60.03 2104 1535660 747884 15.57 195284 1747516 3476 20:16:42 08:14:01 PM 1432700 2845872 2320976 61.83 2104 1552484 777456 16.19 202000 1795764 3280 20:16:42 08:15:01 PM 1522736 3036076 2230940 59.43 2104 1647904 585508 12.19 217608 1674240 3516 20:16:42 08:16:02 PM 1295768 3025764 2457908 65.48 2104 1862760 589056 12.27 225032 1886652 35716 20:16:42 Average: 992828 2922328 2760848 73.55 2104 2078546 699190 14.56 199053 2242027 103077 20:16:42 20:16:42 08:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 20:16:42 08:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:06:01 PM eth0 49.38 42.71 889.23 4.83 0.00 0.00 0.00 0.00 20:16:42 08:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:07:01 PM eth0 63.46 51.75 1029.90 7.06 0.00 0.00 0.00 0.00 20:16:42 08:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:08:01 PM eth0 40.79 37.10 736.50 5.53 0.00 0.00 0.00 0.00 20:16:42 08:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:09:01 PM eth0 367.61 294.30 7517.11 23.11 0.00 0.00 0.00 0.00 20:16:42 08:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:10:01 PM eth0 1706.10 1298.82 40579.58 88.50 0.00 0.00 0.00 0.00 20:16:42 08:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:11:01 PM eth0 1855.54 1426.75 43516.68 97.53 0.00 0.00 0.00 0.00 20:16:42 08:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:12:01 PM eth0 204.13 134.63 3579.71 15.80 0.00 0.00 0.00 0.00 20:16:42 08:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:13:01 PM eth0 47.47 34.37 115.82 12.07 0.00 0.00 0.00 0.00 20:16:42 08:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:14:01 PM eth0 41.14 31.46 107.48 10.92 0.00 0.00 0.00 0.00 20:16:42 08:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:15:01 PM eth0 45.77 33.26 100.11 15.94 0.00 0.00 0.00 0.00 20:16:42 08:16:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 08:16:02 PM eth0 26.65 21.48 279.58 5.96 0.00 0.00 0.00 0.00 20:16:42 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 20:16:42 Average: eth0 404.43 309.74 8951.63 26.12 0.00 0.00 0.00 0.00 20:16:42 20:16:42 20:16:42 ---> sar -P ALL: 20:16:42 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/10/2026 _x86_64_ (2 CPU) 20:16:42 20:16:42 20:03:46 LINUX RESTART (2 CPU) 20:16:42 20:16:42 08:05:01 PM CPU %user %nice %system %iowait %steal %idle 20:16:42 08:06:01 PM all 22.91 0.00 3.06 1.24 0.08 72.71 20:16:42 08:06:01 PM 0 17.22 0.00 2.64 1.35 0.07 78.73 20:16:42 08:06:01 PM 1 28.60 0.00 3.49 1.13 0.08 66.70 20:16:42 08:07:01 PM all 24.74 0.00 3.28 2.05 0.09 69.84 20:16:42 08:07:01 PM 0 18.54 0.00 2.62 2.30 0.08 76.45 20:16:42 08:07:01 PM 1 30.94 0.00 3.94 1.80 0.10 63.22 20:16:42 08:08:01 PM all 30.08 0.00 3.08 0.95 0.10 65.79 20:16:42 08:08:01 PM 0 20.07 0.00 2.08 0.80 0.10 76.95 20:16:42 08:08:01 PM 1 40.13 0.00 4.07 1.10 0.10 54.59 20:16:42 08:09:01 PM all 22.08 0.00 3.66 1.49 0.07 72.70 20:16:42 08:09:01 PM 0 17.93 0.00 2.91 1.12 0.07 77.98 20:16:42 08:09:01 PM 1 26.24 0.00 4.42 1.86 0.07 67.41 20:16:42 08:10:01 PM all 23.86 0.00 11.77 3.06 0.11 61.20 20:16:42 08:10:01 PM 0 15.50 0.00 8.43 2.78 0.10 73.19 20:16:42 08:10:01 PM 1 32.37 0.00 15.16 3.35 0.12 49.00 20:16:42 08:11:01 PM all 21.09 0.00 12.82 3.21 0.11 62.77 20:16:42 08:11:01 PM 0 16.04 0.00 10.33 2.91 0.08 70.62 20:16:42 08:11:01 PM 1 26.22 0.00 15.35 3.51 0.14 54.78 20:16:42 08:12:01 PM all 34.36 0.00 2.66 1.00 0.10 61.87 20:16:42 08:12:01 PM 0 20.21 0.00 1.80 0.99 0.08 76.92 20:16:42 08:12:01 PM 1 48.55 0.00 3.51 1.02 0.12 46.79 20:16:42 08:13:01 PM all 39.04 0.00 1.40 0.33 0.11 59.12 20:16:42 08:13:01 PM 0 14.11 0.00 0.94 0.15 0.08 84.72 20:16:42 08:13:01 PM 1 63.95 0.00 1.87 0.52 0.13 33.52 20:16:42 08:14:01 PM all 39.95 0.00 1.27 0.48 0.10 58.19 20:16:42 08:14:01 PM 0 13.06 0.00 0.87 0.08 0.07 85.92 20:16:42 08:14:01 PM 1 66.83 0.00 1.67 0.89 0.13 30.48 20:16:42 08:15:01 PM all 38.61 0.00 1.71 1.62 0.12 57.94 20:16:42 08:15:01 PM 0 33.14 0.00 1.54 1.17 0.12 64.03 20:16:42 08:15:01 PM 1 44.08 0.00 1.89 2.07 0.12 51.85 20:16:42 08:16:02 PM all 23.58 0.00 3.02 4.84 0.09 68.47 20:16:42 08:16:02 PM 0 18.95 0.00 3.10 5.57 0.07 72.31 20:16:42 08:16:02 PM 1 28.21 0.00 2.94 4.11 0.12 64.63 20:16:42 20:16:42 Average: CPU %user %nice %system %iowait %steal %idle 20:16:42 Average: all 29.13 0.00 4.32 1.84 0.10 64.61 20:16:42 Average: 0 18.62 0.00 3.38 1.75 0.08 76.17 20:16:42 Average: 1 39.68 0.00 5.27 1.94 0.11 53.01 20:16:42 20:16:42 20:16:42