23:04:36 Started by timer 23:04:36 Running as SYSTEM 23:04:36 [EnvInject] - Loading node environment variables. 23:04:36 Building remotely on prd-centos8-builder-2c-4g-2417 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 23:04:36 [ssh-agent] Looking for ssh-agent implementation... 23:04:36 $ ssh-agent 23:04:36 SSH_AUTH_SOCK=/tmp/ssh-0Fo10qOpCKE2/agent.5167 23:04:36 SSH_AGENT_PID=5169 23:04:36 [ssh-agent] Started. 23:04:36 Running ssh-add (command line suppressed) 23:04:36 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_5389756438977106548.key (jenkins-ssh) 23:04:36 [ssh-agent] Using credentials jenkins (jenkins) 23:04:36 The recommended git tool is: NONE 23:04:38 using credential jenkins 23:04:38 Wiping out workspace first. 23:04:38 Cloning the remote Git repository 23:04:38 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 23:04:39 > git init /w/workspace/ci-management-openstack-cron # timeout=10 23:04:39 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 23:04:39 > git --version # timeout=10 23:04:39 > git --version # 'git version 2.43.0' 23:04:39 using GIT_SSH to set credentials jenkins 23:04:39 [INFO] Currently running in a labeled security context 23:04:39 [INFO] Currently SELinux is 'enforcing' on the host 23:04:39 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh10081564262670698348.key 23:04:39 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 23:04:42 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 23:04:42 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 23:04:43 Avoid second fetch 23:04:43 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 23:04:43 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 23:04:43 > git config core.sparsecheckout # timeout=10 23:04:43 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 23:04:43 Commit message: "CI: Update github2gerrit caller to v2.4.4" 23:04:43 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 23:04:43 > git remote # timeout=10 23:04:43 > git submodule init # timeout=10 23:04:44 > git submodule sync # timeout=10 23:04:44 > git config --get remote.origin.url # timeout=10 23:04:44 > git submodule init # timeout=10 23:04:44 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 23:04:44 > git config --get submodule.packer/common-packer.url # timeout=10 23:04:44 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 23:04:44 > git config --get submodule.global-jjb.url # timeout=10 23:04:44 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 23:04:44 > git submodule update --init --recursive packer/common-packer # timeout=10 23:04:48 > git submodule update --init --recursive global-jjb # timeout=10 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 23:04:58 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 23:04:58 provisioning config files... 23:04:58 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 23:04:58 copy managed file [npmrc] to file:/home/jenkins/.npmrc 23:04:58 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 23:04:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5440174995783202286.sh 23:04:58 ---> python-tools-install.sh 23:04:58 Setup pyenv: 23:04:58 system 23:04:58 * 3.8.13 (set by /opt/pyenv/version) 23:04:58 * 3.9.13 (set by /opt/pyenv/version) 23:04:58 * 3.10.6 (set by /opt/pyenv/version) 23:05:03 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-0ZA4 23:05:03 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 23:05:03 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:05:15 lf-activate-venv(): INFO: Installing additional packages: lftools 23:05:50 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:05:50 Generating Requirements File 23:06:34 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 23:06:34 botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 23:06:34 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 23:06:35 Python 3.10.6 23:06:35 pip 26.3 from /tmp/venv-0ZA4/lib/python3.10/site-packages/pip (python 3.10) 23:06:35 aiohappyeyeballs==2.7.1 23:06:35 aiohttp==3.14.5 23:06:35 aiosignal==1.4.0 23:06:35 appdirs==1.4.4 23:06:35 argcomplete==3.7.2 23:06:35 aspy.yaml==1.3.0 23:06:35 async-timeout==5.0.1 23:06:35 attrs==26.1.0 23:06:35 autopage==0.6.0 23:06:35 backports.strenum==1.3.1 23:06:35 beautifulsoup4==4.15.0 23:06:35 boto3==1.43.127 23:06:35 botocore==1.43.127 23:06:35 bs4==0.0.2 23:06:35 certifi==2026.10.23 23:06:35 cffi==2.1.1 23:06:35 cfgv==3.5.0 23:06:35 chardet==7.7.0 23:06:35 charset-normalizer==3.5.2 23:06:35 click==8.5.1 23:06:35 cliff==4.14.0 23:06:35 cmd2==3.5.1 23:06:35 cryptography==3.3.2 23:06:35 debtcollector==3.1.0 23:06:35 decorator==5.3.1 23:06:35 defusedxml==0.7.1 23:06:35 Deprecated==1.3.1 23:06:35 distlib==0.4.4 23:06:35 dnspython==2.8.0 23:06:35 docker==7.2.0 23:06:35 dogpile.cache==1.5.0 23:06:35 durationpy==0.11 23:06:35 email-validator==2.3.0 23:06:35 filelock==4.1.0 23:06:35 frozenlist==1.8.0 23:06:35 future==1.0.0 23:06:35 gitdb==4.0.12 23:06:35 GitPython==3.2.1 23:06:35 httplib2==0.30.2 23:06:35 identify==2.6.20 23:06:35 idna==3.20 23:06:35 importlib-resources==1.5.0 23:06:35 iso8601==2.1.0 23:06:35 Jinja2==3.1.6 23:06:35 jmespath==1.1.0 23:06:35 jsonpatch==1.45 23:06:35 jsonpointer==3.10 23:06:35 jsonschema==4.26.0 23:06:35 jsonschema-specifications==2025.9.1 23:06:35 keystoneauth1==5.14.0 23:06:35 kubernetes==36.0.3 23:06:35 lftools==0.37.26 23:06:35 lxml==6.1.3 23:06:35 markdown-it-py==4.3.0 23:06:35 MarkupSafe==3.0.4 23:06:35 mdurl==0.1.2 23:06:35 msgpack==1.2.4 23:06:35 multi_key_dict==2.0.4 23:06:35 multidict==7.1.0 23:06:35 munch==4.0.0 23:06:35 netaddr==1.3.0 23:06:35 niet==1.4.2 23:06:35 nodeenv==1.12.0 23:06:35 oauth2client==4.1.3 23:06:35 oauthlib==4.0.1 23:06:35 openstacksdk==4.13.0 23:06:35 os-service-types==1.8.2 23:06:35 osc-lib==4.6.0 23:06:35 oslo.config==10.4.0 23:06:35 oslo.context==6.4.0 23:06:35 oslo.i18n==6.8.0 23:06:35 oslo.log==8.2.0 23:06:35 oslo.serialization==5.10.0 23:06:35 oslo.utils==10.1.1 23:06:35 packaging==26.3 23:06:35 pbr==7.1.3 23:06:35 platformdirs==4.12.4 23:06:35 prettytable==3.18.0 23:06:35 propcache==0.5.4 23:06:35 psutil==7.2.2 23:06:35 pyasn1==0.6.5 23:06:35 pyasn1_modules==0.4.2 23:06:35 pycparser==3.11 23:06:35 pygerrit2==2.0.15 23:06:35 PyGithub==2.10.0 23:06:35 Pygments==2.21.0 23:06:35 PyJWT==2.15.1 23:06:35 PyNaCl==1.6.2 23:06:35 pyparsing==2.4.7 23:06:35 pyperclip==1.11.0 23:06:35 pyrsistent==0.20.0 23:06:35 python-cinderclient==9.9.0 23:06:35 python-dateutil==3.0.0 23:06:35 python-discovery==1.9.5 23:06:35 python-heatclient==5.2.0 23:06:35 python-jenkins==1.8.3 23:06:35 python-keystoneclient==6.0.0 23:06:35 python-magnumclient==4.11.0 23:06:35 python-openstackclient==10.0.0 23:06:35 python-swiftclient==4.11.0 23:06:35 PyYAML==6.0.3 23:06:35 referencing==0.37.0 23:06:35 requests==2.34.2 23:06:35 requests-oauthlib==2.0.0 23:06:35 rfc3986==2.0.0 23:06:35 rich==15.0.0 23:06:35 rich-argparse==1.8.0 23:06:35 rpds-py==0.30.0 23:06:35 rsa==4.9.1 23:06:35 ruamel.yaml==0.19.1 23:06:35 ruamel.yaml.clib==0.2.15 23:06:35 s3transfer==0.19.3 23:06:35 simplejson==4.3.0 23:06:35 six==1.17.0 23:06:35 smmap==5.0.3 23:06:35 soupsieve==2.10 23:06:35 stevedore==5.8.0 23:06:35 tabulate==0.10.0 23:06:35 toml==0.10.2 23:06:35 tomlkit==0.15.2 23:06:35 tqdm==4.70.1 23:06:35 typing_extensions==4.16.0 23:06:35 tzdata==2026.6 23:06:35 urllib3==1.26.20 23:06:35 virtualenv==21.15.6 23:06:35 wcwidth==0.9.4 23:06:35 websocket-client==1.9.2 23:06:35 wrapt==2.5.2 23:06:35 xdg==6.0.0 23:06:35 xmltodict==1.0.4 23:06:35 yarl==1.25.1 23:06:35 yq==4.4.5 23:06:35 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins15087407887843969659.sh 23:06:35 ---> uv-install.sh 23:06:35 Installing uv/uvx (latest) using shell installer 23:06:42 2026-11-10 23:06:42 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-PXIG91.sh" [1] 23:06:42 downloading uv 0.13.7 x86_64-unknown-linux-gnu 23:06:46 installing to /home/jenkins/.local/bin 23:06:46 uv 23:06:46 uvx 23:06:46 everything's installed! 23:06:46 ---> Validating uv/uvx install 23:06:46 uvx 0.13.7 (x86_64-unknown-linux-gnu) 23:06:46 [EnvInject] - Injecting environment variables from a build step. 23:06:46 [EnvInject] - Injecting as environment variables the properties content 23:06:46 OS_CLOUD=vex 23:06:46 23:06:46 [EnvInject] - Variables injected successfully. 23:06:46 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 23:06:46 Run condition [Boolean condition] enabling perform for step [Execute shell] 23:06:46 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3933027661376950675.sh 23:06:46 ---> Orphaned k8s clusters 23:06:46 Setup pyenv: 23:06:46 system 23:06:46 3.8.13 23:06:46 3.9.13 23:06:46 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:06:47 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:06:47 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:06:52 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 23:07:18 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 23:07:18 botocore 1.43.127 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 23:07:18 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:07:29 -----> Delete orphaned cluster 23:07:29 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 23:07:29 Run condition [Boolean condition] enabling perform for step [Execute shell] 23:07:29 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1010272399078255491.sh 23:07:29 ---> Orphaned stacks 23:07:29 Setup pyenv: 23:07:29 system 23:07:29 3.8.13 23:07:29 3.9.13 23:07:29 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:07:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:07:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:07:34 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 23:08:06 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:08:06 + mapfile -t OS_COE_CLUSTERS_ID 23:08:06 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 23:08:06 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 23:08:06 ++ awk '{print $1}' 23:08:16 + echo '-----> Active clusters -> stacks' 23:08:16 -----> Active clusters -> stacks 23:08:16 + OS_COE_STACKS=() 23:08:16 + [[ 0 -gt 0 ]] 23:08:16 + mapfile -t OS_STACKS 23:08:16 ++ awk '{print $1}' 23:08:16 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 23:08:25 + echo '-----> Active stacks' 23:08:25 -----> Active stacks 23:08:25 + echo '-----> Delete orphaned stacks' 23:08:25 -----> Delete orphaned stacks 23:08:25 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 23:08:25 Run condition [Boolean condition] enabling perform for step [Execute shell] 23:08:25 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7600706704827014243.sh 23:08:25 ---> Orphaned servers 23:08:25 Setup pyenv: 23:08:25 system 23:08:25 3.8.13 23:08:25 3.9.13 23:08:25 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:08:25 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:08:25 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:08:30 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 23:11:15 ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device 23:11:15 23:11:17 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 23:14:58 Build timed out (after 10 minutes). Marking the build as failed. 23:14:58 $ ssh-agent -k 23:14:58 unset SSH_AUTH_SOCK; 23:14:58 unset SSH_AGENT_PID; 23:14:58 echo Agent pid 5169 killed; 23:14:58 [ssh-agent] Stopped. 23:14:58 Build was aborted 23:14:58 [PostBuildScript] - [INFO] Executing post build scripts. 23:14:58 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5384333703295215577.sh 23:14:58 ---> sysstat.sh 23:14:58 /home/jenkins/lf-env.sh: line 73: 6634 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 23:14:58 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 23:14:58 /tmp/jenkins7600706704827014243.sh: line 67: openstack: command not found 23:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6625813249687465804.sh 23:15:00 ---> package-listing.sh 23:15:00 ++ tr '[:upper:]' '[:lower:]' 23:15:00 ++ facter osfamily 23:15:00 + OS_FAMILY=redhat 23:15:00 + workspace=/w/workspace/ci-management-openstack-cron 23:15:00 + START_PACKAGES=/tmp/packages_start.txt 23:15:00 + END_PACKAGES=/tmp/packages_end.txt 23:15:00 + DIFF_PACKAGES=/tmp/packages_diff.txt 23:15:00 + PACKAGES=/tmp/packages_start.txt 23:15:00 + '[' /w/workspace/ci-management-openstack-cron ']' 23:15:00 + PACKAGES=/tmp/packages_end.txt 23:15:00 + case "${OS_FAMILY}" in 23:15:00 + rpm -qa 23:15:00 + sort 23:15:07 + '[' -f /tmp/packages_start.txt ']' 23:15:07 + '[' -f /tmp/packages_end.txt ']' 23:15:07 + diff /tmp/packages_start.txt /tmp/packages_end.txt 23:15:07 + '[' /w/workspace/ci-management-openstack-cron ']' 23:15:07 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 23:15:07 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 23:15:07 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4979788911424370290.sh 23:15:07 ---> capture-instance-metadata.sh 23:15:07 Setup pyenv: 23:15:07 system 23:15:07 3.8.13 23:15:07 3.9.13 23:15:07 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:15:08 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:15:08 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:15:12 lf-activate-venv(): INFO: Installing additional packages: lftools 23:15:28 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:15:28 INFO: Running in OpenStack, capturing instance metadata 23:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17707969912334604482.sh 23:15:28 provisioning config files... 23:15:28 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config1519770505262795132tmp 23:15:28 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 23:15:28 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 23:15:28 [EnvInject] - Injecting environment variables from a build step. 23:15:28 [EnvInject] - Injecting as environment variables the properties content 23:15:28 SERVER_ID=logs 23:15:28 23:15:28 [EnvInject] - Variables injected successfully. 23:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13143368382358028849.sh 23:15:28 ---> create-netrc.sh 23:15:28 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10470676644511728806.sh 23:15:28 ---> python-tools-install.sh 23:15:28 Setup pyenv: 23:15:28 system 23:15:28 3.8.13 23:15:28 3.9.13 23:15:28 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:15:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:15:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:15:34 lf-activate-venv(): INFO: Installing additional packages: lftools 23:15:49 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:15:49 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins7694891545563225710.sh 23:15:49 ---> uv-install.sh 23:15:49 uv 0.13.7 is already installed 23:15:49 uvx 0.13.7 (x86_64-unknown-linux-gnu) 23:15:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5602627930844757659.sh 23:15:49 ---> sudo-logs.sh 23:15:49 Archiving 'sudo' log.. 23:15:49 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1192553246219724678.sh 23:15:49 ---> job-cost.sh 23:15:49 INFO: Activating Python virtual environment... 23:15:49 Setup pyenv: 23:15:49 system 23:15:49 3.8.13 23:15:49 3.9.13 23:15:49 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:15:50 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:15:50 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:15:55 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 23:16:06 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:16:06 INFO: No stack-cost file found 23:16:06 INFO: Instance uptime: 748s 23:16:06 INFO: Fetching instance metadata (attempt 1 of 3)... 23:16:06 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 23:16:07 INFO: Successfully fetched instance metadata 23:16:07 INFO: Instance type: v3-starter-2 23:16:07 INFO: Retrieving pricing info for: v3-starter-2 23:16:07 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 23:16:07 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=748 23:16:10 INFO: Successfully fetched Vexxhost pricing API 23:16:10 INFO: Retrieved cost: 0.02 23:16:10 INFO: Retrieved resource: v3-starter-2 23:16:10 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 23:16:10 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 23:16:10 INFO: Successfully archived job cost data 23:16:10 DEBUG: Cost data: ci-management-openstack-cron,63756,2026-11-10 23:16:10,v3-starter-2,748,0.02,0.00,FAILURE 23:16:10 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2730654640167166654.sh 23:16:10 ---> logs-deploy.sh 23:16:10 Setup pyenv: 23:16:10 system 23:16:10 3.8.13 23:16:10 3.9.13 23:16:10 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 23:16:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-0ZA4 from file:/tmp/.os_lf_venv 23:16:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 23:16:15 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 23:16:30 lf-activate-venv(): INFO: Adding /tmp/venv-0ZA4/bin to PATH 23:16:30 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63756 23:16:30 INFO: archiving workspace using pattern(s): 23:16:36 Archives upload complete. 23:16:36 INFO: archiving logs to Nexus 23:16:37 ---> uname -a: 23:16:37 Linux prd-centos8-builder-2c-4g-2417.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 23:16:37 23:16:37 23:16:37 ---> lscpu: 23:16:37 Architecture: x86_64 23:16:37 CPU op-mode(s): 32-bit, 64-bit 23:16:37 Byte Order: Little Endian 23:16:37 CPU(s): 2 23:16:37 On-line CPU(s) list: 0,1 23:16:37 Thread(s) per core: 1 23:16:37 Core(s) per socket: 1 23:16:37 Socket(s): 2 23:16:37 NUMA node(s): 1 23:16:37 Vendor ID: AuthenticAMD 23:16:37 CPU family: 23 23:16:37 Model: 49 23:16:37 Model name: AMD EPYC-Rome Processor 23:16:37 Stepping: 0 23:16:37 CPU MHz: 2799.998 23:16:37 BogoMIPS: 5599.99 23:16:37 Virtualization: AMD-V 23:16:37 Hypervisor vendor: KVM 23:16:37 Virtualization type: full 23:16:37 L1d cache: 32K 23:16:37 L1i cache: 32K 23:16:37 L2 cache: 512K 23:16:37 L3 cache: 16384K 23:16:37 NUMA node0 CPU(s): 0,1 23:16:37 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 23:16:37 23:16:37 23:16:37 ---> nproc: 23:16:37 2 23:16:37 23:16:37 23:16:37 ---> df -h: 23:16:37 Filesystem Size Used Avail Use% Mounted on 23:16:37 devtmpfs 1.8G 0 1.8G 0% /dev 23:16:37 tmpfs 1.8G 0 1.8G 0% /dev/shm 23:16:37 tmpfs 1.8G 17M 1.8G 1% /run 23:16:37 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 23:16:37 /dev/vda1 20G 15G 5.4G 74% / 23:16:37 tmpfs 367M 0 367M 0% /run/user/1001 23:16:37 23:16:37 23:16:37 ---> free -m: 23:16:37 total used free shared buff/cache available 23:16:37 Mem: 3665 432 1271 17 1961 2933 23:16:37 Swap: 1023 0 1023 23:16:37 23:16:37 23:16:37 ---> ip addr: 23:16:37 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 23:16:37 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 23:16:37 inet 127.0.0.1/8 scope host lo 23:16:37 valid_lft forever preferred_lft forever 23:16:37 inet6 ::1/128 scope host 23:16:37 valid_lft forever preferred_lft forever 23:16:37 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 23:16:37 link/ether fa:16:3e:b3:18:1c brd ff:ff:ff:ff:ff:ff 23:16:37 altname enp0s3 23:16:37 altname ens3 23:16:37 inet 10.32.6.183/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 23:16:37 valid_lft 85653sec preferred_lft 85653sec 23:16:37 inet6 fe80::f816:3eff:feb3:181c/64 scope link 23:16:37 valid_lft forever preferred_lft forever 23:16:37 23:16:37 23:16:37 ---> sar -b -r -n DEV: 23:16:37 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/10/2026 _x86_64_ (2 CPU) 23:16:37 23:16:37 23:03:45 LINUX RESTART (2 CPU) 23:16:37 23:16:37 11:05:01 PM tps rtps wtps bread/s bwrtn/s 23:16:37 11:06:01 PM 49.90 0.75 49.15 48.25 5218.98 23:16:37 11:07:01 PM 61.22 0.73 60.49 202.10 9436.79 23:16:37 11:08:01 PM 42.97 0.47 42.50 60.11 11791.44 23:16:37 11:09:01 PM 43.92 0.23 43.69 41.59 26351.00 23:16:37 11:10:01 PM 108.31 0.98 107.33 142.04 155167.19 23:16:37 11:11:02 PM 119.24 4.76 114.48 453.51 159231.47 23:16:37 11:12:01 PM 68.86 3.00 65.86 484.58 46208.88 23:16:37 11:13:01 PM 67.16 0.18 66.98 4.27 1706.43 23:16:37 11:14:01 PM 61.40 0.05 61.35 1.60 1655.65 23:16:37 11:15:01 PM 80.20 21.51 58.69 2203.10 1532.09 23:16:37 11:16:01 PM 89.77 69.71 20.06 5930.42 636.85 23:16:37 Average: 72.09 9.32 62.78 870.69 38079.22 23:16:37 23:16:37 11:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 23:16:37 11:06:01 PM 1413316 3063284 2340360 62.35 2104 1818844 588788 12.26 136432 1915568 138008 23:16:37 11:07:01 PM 1079324 2988684 2674352 71.25 2104 2068736 625756 13.03 138876 2210420 152860 23:16:37 11:08:01 PM 748604 2873856 3005072 80.06 2104 2280920 737828 15.36 160348 2506572 131992 23:16:37 11:09:01 PM 141428 2890032 3612248 96.23 2104 2907372 721076 15.02 189728 3089956 220600 23:16:37 11:10:01 PM 114372 2849572 3639304 96.95 2104 2888384 774368 16.13 240756 3069904 239852 23:16:37 11:11:02 PM 128868 2834824 3624808 96.57 2104 2852952 826472 17.21 287828 3043080 214848 23:16:37 11:12:01 PM 1590848 2951300 2162828 57.62 2104 1509320 711776 14.82 185072 1685192 2164 23:16:37 11:13:01 PM 1549260 2928736 2204416 58.73 2104 1524592 726864 15.14 191192 1708976 3476 23:16:37 11:14:01 PM 1494856 2890928 2258820 60.18 2104 1537944 757368 15.77 196536 1747788 2732 23:16:37 11:15:01 PM 1581784 3054380 2171892 57.86 2104 1615100 589164 12.27 209532 1635768 3000 23:16:37 11:16:01 PM 1368076 3027792 2385600 63.55 2104 1801512 596900 12.43 217504 1837548 8784 23:16:37 Average: 1019158 2941217 2734518 72.85 2104 2073243 696033 14.49 195800 2222797 101665 23:16:37 23:16:37 11:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 23:16:37 11:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:06:01 PM eth0 44.02 39.25 887.65 4.61 0.00 0.00 0.00 0.00 23:16:37 11:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:07:01 PM eth0 67.79 57.97 1024.03 7.35 0.00 0.00 0.00 0.00 23:16:37 11:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:08:01 PM eth0 39.32 35.52 737.44 5.55 0.00 0.00 0.00 0.00 23:16:37 11:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:09:01 PM eth0 337.19 262.01 6964.84 20.51 0.00 0.00 0.00 0.00 23:16:37 11:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:10:01 PM eth0 1752.80 1305.55 38898.33 89.11 0.00 0.00 0.00 0.00 23:16:37 11:11:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:11:02 PM eth0 1747.18 1251.12 39717.16 85.52 0.00 0.00 0.00 0.00 23:16:37 11:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:12:01 PM eth0 467.77 326.86 9783.50 26.66 0.00 0.00 0.00 0.00 23:16:37 11:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:13:01 PM eth0 79.52 37.50 97.76 10.50 0.00 0.00 0.00 0.00 23:16:37 11:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:14:01 PM eth0 67.53 32.24 85.46 9.12 0.00 0.00 0.00 0.00 23:16:37 11:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:15:01 PM eth0 68.21 33.69 85.76 13.51 0.00 0.00 0.00 0.00 23:16:37 11:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 11:16:01 PM eth0 11.65 12.11 8.89 5.78 0.00 0.00 0.00 0.00 23:16:37 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 23:16:37 Average: eth0 425.73 308.56 8935.87 25.29 0.00 0.00 0.00 0.00 23:16:37 23:16:37 23:16:37 ---> sar -P ALL: 23:16:37 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/10/2026 _x86_64_ (2 CPU) 23:16:37 23:16:37 23:03:45 LINUX RESTART (2 CPU) 23:16:37 23:16:37 11:05:01 PM CPU %user %nice %system %iowait %steal %idle 23:16:37 11:06:01 PM all 22.76 0.00 2.90 1.47 0.08 72.79 23:16:37 11:06:01 PM 0 14.18 0.00 2.30 1.42 0.07 82.03 23:16:37 11:06:01 PM 1 31.33 0.00 3.50 1.52 0.08 63.57 23:16:37 11:07:01 PM all 24.59 0.00 3.42 2.43 0.08 69.48 23:16:37 11:07:01 PM 0 29.45 0.00 3.98 2.57 0.08 63.92 23:16:37 11:07:01 PM 1 19.73 0.00 2.87 2.29 0.08 75.03 23:16:37 11:08:01 PM all 29.39 0.00 3.00 1.17 0.08 66.36 23:16:37 11:08:01 PM 0 14.21 0.00 2.52 1.63 0.07 81.57 23:16:37 11:08:01 PM 1 44.57 0.00 3.49 0.70 0.10 51.14 23:16:37 11:09:01 PM all 22.77 0.00 3.63 1.13 0.08 72.40 23:16:37 11:09:01 PM 0 12.62 0.00 3.83 1.19 0.07 82.30 23:16:37 11:09:01 PM 1 32.93 0.00 3.43 1.07 0.08 62.48 23:16:37 11:10:01 PM all 23.40 0.00 12.03 2.55 0.12 61.90 23:16:37 11:10:01 PM 0 17.30 0.00 9.06 2.42 0.10 71.12 23:16:37 11:10:01 PM 1 29.59 0.00 15.04 2.69 0.14 52.54 23:16:37 11:11:02 PM all 21.61 0.00 13.20 2.84 0.12 62.23 23:16:37 11:11:02 PM 0 18.36 0.00 10.44 2.36 0.12 68.73 23:16:37 11:11:02 PM 1 24.91 0.00 16.00 3.33 0.12 55.65 23:16:37 11:12:01 PM all 28.08 0.00 4.31 0.96 0.09 66.55 23:16:37 11:12:01 PM 0 6.04 0.00 3.01 0.78 0.07 90.09 23:16:37 11:12:01 PM 1 50.16 0.00 5.61 1.14 0.12 42.96 23:16:37 11:13:01 PM all 29.80 0.00 1.43 0.28 0.11 68.39 23:16:37 11:13:01 PM 0 10.93 0.00 0.99 0.10 0.08 87.90 23:16:37 11:13:01 PM 1 48.67 0.00 1.87 0.45 0.13 48.87 23:16:37 11:14:01 PM all 32.00 0.00 1.22 0.42 0.09 66.27 23:16:37 11:14:01 PM 0 9.42 0.00 0.74 0.20 0.07 89.58 23:16:37 11:14:01 PM 1 54.56 0.00 1.71 0.64 0.12 42.98 23:16:37 11:15:01 PM all 31.95 0.00 1.51 1.18 0.10 65.26 23:16:37 11:15:01 PM 0 12.70 0.00 1.27 1.77 0.08 84.17 23:16:37 11:15:01 PM 1 51.19 0.00 1.75 0.58 0.12 46.35 23:16:37 11:16:01 PM all 23.30 0.00 2.51 5.45 0.08 68.67 23:16:37 11:16:01 PM 0 8.24 0.00 1.82 1.07 0.05 88.82 23:16:37 11:16:01 PM 1 38.35 0.00 3.19 9.83 0.10 48.53 23:16:37 23:16:37 Average: CPU %user %nice %system %iowait %steal %idle 23:16:37 Average: all 26.34 0.00 4.45 1.81 0.09 67.31 23:16:37 Average: 0 13.96 0.00 3.63 1.41 0.08 80.92 23:16:37 Average: 1 38.74 0.00 5.28 2.20 0.11 53.67 23:16:37 23:16:37 23:16:37