00:25:08 Started by timer 00:25:08 Running as SYSTEM 00:25:08 [EnvInject] - Loading node environment variables. 00:25:08 Building remotely on prd-centos8-builder-2c-4g-10509 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 00:25:08 [ssh-agent] Looking for ssh-agent implementation... 00:25:08 $ ssh-agent 00:25:08 SSH_AUTH_SOCK=/tmp/ssh-4Z0ph7Tl0Tpr/agent.5200 00:25:08 SSH_AGENT_PID=5202 00:25:08 [ssh-agent] Started. 00:25:08 Running ssh-add (command line suppressed) 00:25:08 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13360536479219800252.key (jenkins-ssh) 00:25:08 [ssh-agent] Using credentials jenkins (jenkins) 00:25:08 The recommended git tool is: NONE 00:25:10 using credential jenkins 00:25:11 Wiping out workspace first. 00:25:11 Cloning the remote Git repository 00:25:11 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:25:11 > git init /w/workspace/ci-management-openstack-cron # timeout=10 00:25:11 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 00:25:11 > git --version # timeout=10 00:25:11 > git --version # 'git version 2.43.0' 00:25:11 using GIT_SSH to set credentials jenkins 00:25:11 [INFO] Currently running in a labeled security context 00:25:11 [INFO] Currently SELinux is 'enforcing' on the host 00:25:11 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh12958163560150349094.key 00:25:11 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 00:25:15 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 00:25:15 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:25:16 Avoid second fetch 00:25:16 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 00:25:16 Checking out Revision fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c (refs/remotes/origin/master) 00:25:16 > git config core.sparsecheckout # timeout=10 00:25:16 > git checkout -f fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 00:25:16 Commit message: "Chore: Update global-jjb to v0.95.0" 00:25:16 > git rev-list --no-walk fb0221d035ce03bdb0037f4f5f8fc2c61f446a5c # timeout=10 00:25:16 > git remote # timeout=10 00:25:16 > git submodule init # timeout=10 00:25:16 > git submodule sync # timeout=10 00:25:16 > git config --get remote.origin.url # timeout=10 00:25:16 > git submodule init # timeout=10 00:25:16 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 00:25:16 > git config --get submodule.packer/common-packer.url # timeout=10 00:25:16 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 00:25:16 > git config --get submodule.global-jjb.url # timeout=10 00:25:16 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 00:25:17 > git submodule update --init --recursive packer/common-packer # timeout=10 00:25:21 > git submodule update --init --recursive global-jjb # timeout=10 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 00:25:31 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 00:25:31 provisioning config files... 00:25:31 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 00:25:31 copy managed file [npmrc] to file:/home/jenkins/.npmrc 00:25:31 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 00:25:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1354887140261436229.sh 00:25:31 ---> python-tools-install.sh 00:25:31 Setup pyenv: 00:25:31 system 00:25:31 * 3.8.13 (set by /opt/pyenv/version) 00:25:31 * 3.9.13 (set by /opt/pyenv/version) 00:25:31 * 3.10.6 (set by /opt/pyenv/version) 00:25:36 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-NocV 00:25:36 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 00:25:36 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:25:47 lf-activate-venv(): INFO: Installing additional packages: lftools 00:26:25 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:26:25 Generating Requirements File 00:27:07 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 00:27:07 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 00:27:08 Python 3.10.6 00:27:08 pip 26.2.1 from /tmp/venv-NocV/lib/python3.10/site-packages/pip (python 3.10) 00:27:08 aiohappyeyeballs==2.7.1 00:27:08 aiohttp==3.14.3 00:27:08 aiosignal==1.4.0 00:27:08 appdirs==1.4.4 00:27:08 argcomplete==3.7.2 00:27:08 aspy.yaml==1.3.0 00:27:08 async-timeout==5.0.1 00:27:08 attrs==26.1.0 00:27:08 autopage==0.6.0 00:27:08 backports.strenum==1.3.1 00:27:08 beautifulsoup4==4.15.0 00:27:08 boto3==1.43.90 00:27:08 botocore==1.43.90 00:27:08 bs4==0.0.2 00:27:08 certifi==2026.7.22 00:27:08 cffi==2.1.1 00:27:08 cfgv==3.5.0 00:27:08 chardet==7.6.0 00:27:08 charset-normalizer==3.5.1 00:27:08 click==8.5.0 00:27:08 cliff==4.14.0 00:27:08 cmd2==3.5.1 00:27:08 cryptography==3.3.2 00:27:08 debtcollector==3.1.0 00:27:08 decorator==5.3.1 00:27:08 defusedxml==0.7.1 00:27:08 Deprecated==1.3.1 00:27:08 distlib==0.4.3 00:27:08 dnspython==2.8.0 00:27:08 docker==7.2.0 00:27:08 dogpile.cache==1.5.0 00:27:08 durationpy==0.11 00:27:08 email-validator==2.3.0 00:27:08 filelock==3.32.6 00:27:08 frozenlist==1.8.0 00:27:08 future==1.0.0 00:27:08 gitdb==4.0.12 00:27:08 GitPython==3.1.62 00:27:08 httplib2==0.30.2 00:27:08 identify==2.6.19 00:27:08 idna==3.19 00:27:08 importlib-resources==1.5.0 00:27:08 iso8601==2.1.0 00:27:08 Jinja2==3.1.6 00:27:08 jmespath==1.1.0 00:27:08 jsonpatch==1.33 00:27:08 jsonpointer==3.1.1 00:27:08 jsonschema==4.26.0 00:27:08 jsonschema-specifications==2025.9.1 00:27:08 keystoneauth1==5.14.0 00:27:08 kubernetes==36.0.3 00:27:08 lftools==0.37.23 00:27:08 lxml==6.1.3 00:27:08 markdown-it-py==4.2.0 00:27:08 MarkupSafe==3.0.3 00:27:08 mdurl==0.1.2 00:27:08 msgpack==1.2.2 00:27:08 multi_key_dict==2.0.3 00:27:08 multidict==6.8.0 00:27:08 munch==4.0.0 00:27:08 netaddr==1.3.0 00:27:08 niet==1.4.2 00:27:08 nodeenv==1.10.0 00:27:08 oauth2client==4.1.3 00:27:08 oauthlib==3.3.1 00:27:08 openstacksdk==4.13.0 00:27:08 os-service-types==1.8.2 00:27:08 osc-lib==4.6.0 00:27:08 oslo.config==10.4.0 00:27:08 oslo.context==6.4.0 00:27:08 oslo.i18n==6.8.0 00:27:08 oslo.log==8.2.0 00:27:08 oslo.serialization==5.10.0 00:27:08 oslo.utils==10.1.1 00:27:08 packaging==26.3 00:27:08 pbr==7.0.3 00:27:08 platformdirs==4.11.8 00:27:08 prettytable==3.18.0 00:27:08 propcache==0.5.2 00:27:08 psutil==7.2.2 00:27:08 pyasn1==0.6.4 00:27:08 pyasn1_modules==0.4.2 00:27:08 pycparser==3.0 00:27:08 pygerrit2==2.0.15 00:27:08 PyGithub==2.10.0 00:27:08 Pygments==2.21.0 00:27:08 PyJWT==2.13.0 00:27:08 PyNaCl==1.6.2 00:27:08 pyparsing==2.4.7 00:27:08 pyperclip==1.11.0 00:27:08 pyrsistent==0.20.0 00:27:08 python-cinderclient==9.9.0 00:27:08 python-dateutil==2.9.0.post0 00:27:08 python-discovery==1.6.0 00:27:08 python-heatclient==5.2.0 00:27:08 python-jenkins==1.8.3 00:27:08 python-keystoneclient==6.0.0 00:27:08 python-magnumclient==4.11.0 00:27:08 python-openstackclient==10.0.0 00:27:08 python-swiftclient==4.11.0 00:27:08 PyYAML==6.0.3 00:27:08 referencing==0.37.0 00:27:08 requests==2.34.2 00:27:08 requests-oauthlib==2.0.0 00:27:08 rfc3986==2.0.0 00:27:08 rich==15.0.0 00:27:08 rich-argparse==1.8.0 00:27:08 rpds-py==0.30.0 00:27:08 rsa==4.9.1 00:27:08 ruamel.yaml==0.19.1 00:27:08 ruamel.yaml.clib==0.2.15 00:27:08 s3transfer==0.19.2 00:27:08 simplejson==4.1.2 00:27:08 six==1.17.0 00:27:08 smmap==5.0.3 00:27:08 soupsieve==2.9.2 00:27:08 stevedore==5.8.0 00:27:08 tabulate==0.10.0 00:27:08 toml==0.10.2 00:27:08 tomlkit==0.15.1 00:27:08 tqdm==4.70.0 00:27:08 typing_extensions==4.16.0 00:27:08 urllib3==1.26.20 00:27:08 virtualenv==21.7.9 00:27:08 wcwidth==0.8.3 00:27:08 websocket-client==1.9.2 00:27:08 wrapt==2.4.0 00:27:08 xdg==6.0.0 00:27:08 xmltodict==1.0.4 00:27:08 yarl==1.24.5 00:27:08 yq==4.1.2 00:27:08 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13915811428444804649.sh 00:27:08 ---> uv-install.sh 00:27:08 Installing uv/uvx (latest) using shell installer 00:27:13 2026-09-10 00:27:13 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71308/71308] -> "/tmp/uv-install-vzMEJH.sh" [1] 00:27:13 downloading uv 0.12.12 x86_64-unknown-linux-gnu 00:27:18 installing to /home/jenkins/.local/bin 00:27:18 uv 00:27:18 uvx 00:27:18 everything's installed! 00:27:18 ---> Validating uv/uvx install 00:27:18 uvx 0.12.12 (x86_64-unknown-linux-gnu) 00:27:18 [EnvInject] - Injecting environment variables from a build step. 00:27:18 [EnvInject] - Injecting as environment variables the properties content 00:27:18 OS_CLOUD=vex 00:27:18 00:27:18 [EnvInject] - Variables injected successfully. 00:27:18 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:27:18 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:27:18 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16879743854714124143.sh 00:27:18 ---> Orphaned k8s clusters 00:27:18 Setup pyenv: 00:27:18 system 00:27:18 3.8.13 00:27:18 3.9.13 00:27:18 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:27:18 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:27:18 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:27:22 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 00:27:35 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:28:45 -----> Delete orphaned cluster 00:28:45 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:28:45 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:28:45 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15994587500888632873.sh 00:28:45 ---> Orphaned stacks 00:28:45 Setup pyenv: 00:28:45 system 00:28:45 3.8.13 00:28:45 3.9.13 00:28:45 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:28:45 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:28:45 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:28:50 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 00:29:15 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:29:15 + mapfile -t OS_COE_CLUSTERS_ID 00:29:15 ++ awk '{print $1}' 00:29:15 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 00:29:15 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 00:32:23 Gateway Timeout (HTTP 504) 00:32:23 + echo '-----> Active clusters -> stacks' 00:32:23 -----> Active clusters -> stacks 00:32:23 + OS_COE_STACKS=() 00:32:23 + [[ 0 -gt 0 ]] 00:32:23 + mapfile -t OS_STACKS 00:32:23 ++ awk '{print $1}' 00:32:23 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 00:33:31 + echo '-----> Active stacks' 00:33:31 -----> Active stacks 00:33:31 + echo '-----> Delete orphaned stacks' 00:33:31 -----> Delete orphaned stacks 00:33:31 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 00:33:31 Run condition [Boolean condition] enabling perform for step [Execute shell] 00:33:31 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3266751283256625005.sh 00:33:32 ---> Orphaned servers 00:33:32 Setup pyenv: 00:33:32 system 00:33:32 3.8.13 00:33:32 3.9.13 00:33:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:33:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:33:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:33:37 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 00:33:59 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:34:13 -----> Active servers 00:34:13 prd-centos8-builder-2c-4g-10504 00:34:13 prd-ubuntu1804-docker-4c-4g-10513 00:34:13 prd-ubuntu1804-docker-4c-4g-10512 00:34:13 prd-ubuntu1804-docker-4c-4g-10511 00:34:13 prd-centos8-builder-2c-4g-10509 00:34:13 -----> Delete orphaned servers 00:34:19 Deleting orphaned server: prd-centos8-builder-2c-4g-10504 00:35:31 Build timed out (after 10 minutes). Marking the build as failed. 00:35:31 $ ssh-agent -k 00:35:31 unset SSH_AUTH_SOCK; 00:35:31 unset SSH_AGENT_PID; 00:35:31 echo Agent pid 5202 killed; 00:35:31 [ssh-agent] Stopped. 00:35:31 Build was aborted 00:35:31 [PostBuildScript] - [INFO] Executing post build scripts. 00:35:31 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10637484727762466945.sh 00:35:31 ---> sysstat.sh 00:35:31 /tmp/jenkins3266751283256625005.sh: line 81: 6704 Terminated lftools openstack --os-cloud "$os_cloud" server remove --minutes 15 "$server" 00:35:32 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9747478914267809721.sh 00:35:32 ---> package-listing.sh 00:35:32 ++ tr '[:upper:]' '[:lower:]' 00:35:32 ++ facter osfamily 00:35:32 + OS_FAMILY=redhat 00:35:32 + workspace=/w/workspace/ci-management-openstack-cron 00:35:32 + START_PACKAGES=/tmp/packages_start.txt 00:35:32 + END_PACKAGES=/tmp/packages_end.txt 00:35:32 + DIFF_PACKAGES=/tmp/packages_diff.txt 00:35:32 + PACKAGES=/tmp/packages_start.txt 00:35:32 + '[' /w/workspace/ci-management-openstack-cron ']' 00:35:32 + PACKAGES=/tmp/packages_end.txt 00:35:32 + case "${OS_FAMILY}" in 00:35:32 + rpm -qa 00:35:32 + sort 00:35:33 + '[' -f /tmp/packages_start.txt ']' 00:35:33 + '[' -f /tmp/packages_end.txt ']' 00:35:33 + diff /tmp/packages_start.txt /tmp/packages_end.txt 00:35:33 + '[' /w/workspace/ci-management-openstack-cron ']' 00:35:33 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 00:35:33 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 00:35:33 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16124089003024631914.sh 00:35:33 ---> capture-instance-metadata.sh 00:35:33 Setup pyenv: 00:35:33 system 00:35:33 3.8.13 00:35:33 3.9.13 00:35:33 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:35:33 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:35:33 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:35:35 (23) Failed writing body 00:35:36 lf-activate-venv(): INFO: Installing additional packages: lftools 00:35:50 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:35:50 INFO: Running in OpenStack, capturing instance metadata 00:35:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10537486692244580434.sh 00:35:51 provisioning config files... 00:35:51 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config8008646459035455930tmp 00:35:51 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 00:35:51 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 00:35:51 [EnvInject] - Injecting environment variables from a build step. 00:35:51 [EnvInject] - Injecting as environment variables the properties content 00:35:51 SERVER_ID=logs 00:35:51 00:35:51 [EnvInject] - Variables injected successfully. 00:35:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11976781938004404989.sh 00:35:51 ---> create-netrc.sh 00:35:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1499366703879276952.sh 00:35:51 ---> python-tools-install.sh 00:35:51 Setup pyenv: 00:35:51 system 00:35:51 3.8.13 00:35:51 3.9.13 00:35:51 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:35:51 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:35:51 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:35:56 lf-activate-venv(): INFO: Installing additional packages: lftools 00:36:10 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:36:10 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins4793604196651310895.sh 00:36:10 ---> uv-install.sh 00:36:10 uv 0.12.12 is already installed 00:36:10 uvx 0.12.12 (x86_64-unknown-linux-gnu) 00:36:10 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13527415803157083302.sh 00:36:10 ---> sudo-logs.sh 00:36:10 Archiving 'sudo' log.. 00:36:10 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10531238257506205212.sh 00:36:10 ---> job-cost.sh 00:36:10 INFO: Activating Python virtual environment... 00:36:10 Setup pyenv: 00:36:11 system 00:36:11 3.8.13 00:36:11 3.9.13 00:36:11 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:36:11 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:36:11 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:36:16 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 00:36:27 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:36:27 INFO: No stack-cost file found 00:36:27 INFO: Instance uptime: 739s 00:36:27 INFO: Fetching instance metadata (attempt 1 of 3)... 00:36:27 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 00:36:27 INFO: Successfully fetched instance metadata 00:36:27 INFO: Instance type: v3-starter-2 00:36:27 INFO: Retrieving pricing info for: v3-starter-2 00:36:27 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 00:36:27 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=739 00:36:31 INFO: Successfully fetched Vexxhost pricing API 00:36:31 INFO: Retrieved cost: 0.02 00:36:31 INFO: Retrieved resource: v3-starter-2 00:36:31 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 00:36:31 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 00:36:31 INFO: Successfully archived job cost data 00:36:31 DEBUG: Cost data: ci-management-openstack-cron,62269,2026-09-10 00:36:31,v3-starter-2,739,0.02,0.00,FAILURE 00:36:31 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11310785511702817412.sh 00:36:31 ---> logs-deploy.sh 00:36:31 Setup pyenv: 00:36:31 system 00:36:31 3.8.13 00:36:31 3.9.13 00:36:31 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 00:36:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-NocV from file:/tmp/.os_lf_venv 00:36:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 00:36:36 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 00:36:50 lf-activate-venv(): INFO: Adding /tmp/venv-NocV/bin to PATH 00:36:50 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/62269 00:36:50 INFO: archiving workspace using pattern(s): 00:36:54 Archives upload complete. 00:36:55 INFO: archiving logs to Nexus 00:36:55 ---> uname -a: 00:36:55 Linux prd-centos8-builder-2c-4g-10509.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 00:36:55 00:36:55 00:36:55 ---> lscpu: 00:36:55 Architecture: x86_64 00:36:55 CPU op-mode(s): 32-bit, 64-bit 00:36:55 Byte Order: Little Endian 00:36:55 CPU(s): 2 00:36:55 On-line CPU(s) list: 0,1 00:36:55 Thread(s) per core: 1 00:36:55 Core(s) per socket: 1 00:36:55 Socket(s): 2 00:36:55 NUMA node(s): 1 00:36:55 Vendor ID: AuthenticAMD 00:36:55 CPU family: 23 00:36:55 Model: 49 00:36:55 Model name: AMD EPYC-Rome Processor 00:36:55 Stepping: 0 00:36:55 CPU MHz: 2799.998 00:36:55 BogoMIPS: 5599.99 00:36:55 Virtualization: AMD-V 00:36:55 Hypervisor vendor: KVM 00:36:55 Virtualization type: full 00:36:55 L1d cache: 32K 00:36:55 L1i cache: 32K 00:36:55 L2 cache: 512K 00:36:55 L3 cache: 16384K 00:36:55 NUMA node0 CPU(s): 0,1 00:36:55 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 00:36:55 00:36:55 00:36:55 ---> nproc: 00:36:55 2 00:36:55 00:36:55 00:36:55 ---> df -h: 00:36:55 Filesystem Size Used Avail Use% Mounted on 00:36:55 devtmpfs 1.8G 0 1.8G 0% /dev 00:36:55 tmpfs 1.8G 0 1.8G 0% /dev/shm 00:36:55 tmpfs 1.8G 17M 1.8G 1% /run 00:36:55 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 00:36:55 /dev/vda1 20G 9.2G 11G 46% / 00:36:55 tmpfs 367M 0 367M 0% /run/user/1001 00:36:55 00:36:55 00:36:55 ---> free -m: 00:36:55 total used free shared buff/cache available 00:36:55 Mem: 3665 514 977 17 2173 2873 00:36:55 Swap: 1023 0 1023 00:36:55 00:36:55 00:36:55 ---> ip addr: 00:36:55 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 00:36:55 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 00:36:55 inet 127.0.0.1/8 scope host lo 00:36:55 valid_lft forever preferred_lft forever 00:36:55 inet6 ::1/128 scope host 00:36:55 valid_lft forever preferred_lft forever 00:36:55 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 00:36:55 link/ether fa:16:3e:ef:4c:fc brd ff:ff:ff:ff:ff:ff 00:36:55 altname enp0s3 00:36:55 altname ens3 00:36:55 inet 10.32.6.242/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 00:36:55 valid_lft 85664sec preferred_lft 85664sec 00:36:55 inet6 fe80::f816:3eff:feef:4cfc/64 scope link 00:36:55 valid_lft forever preferred_lft forever 00:36:55 00:36:55 00:36:55 ---> sar -b -r -n DEV: 00:36:55 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/10/2026 _x86_64_ (2 CPU) 00:36:55 00:36:55 00:24:15 LINUX RESTART (2 CPU) 00:36:55 00:36:55 12:25:01 AM tps rtps wtps bread/s bwrtn/s 00:36:55 12:26:01 AM 99.80 18.73 81.07 3798.73 38314.66 00:36:55 12:27:01 AM 70.46 0.08 70.38 1.60 8536.12 00:36:55 12:28:01 AM 41.93 1.27 40.66 234.89 7817.03 00:36:55 12:29:01 AM 9.45 0.00 9.45 0.00 966.86 00:36:55 12:30:01 AM 18.28 0.05 18.23 1.33 2266.96 00:36:55 12:31:01 AM 2.38 0.00 2.38 0.00 85.62 00:36:55 12:32:01 AM 0.47 0.00 0.47 0.00 5.58 00:36:55 12:33:01 AM 0.33 0.00 0.33 0.00 3.45 00:36:55 12:34:01 AM 9.86 0.00 9.86 0.00 269.93 00:36:55 12:35:01 AM 8.10 0.80 7.30 51.86 364.77 00:36:55 12:36:01 AM 10.45 0.25 10.20 25.06 297.68 00:36:55 Average: 24.68 1.93 22.76 373.97 5357.24 00:36:55 00:36:55 12:25:01 AM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 00:36:55 12:26:01 AM 1495300 2994340 2258376 60.16 2104 1677600 656708 13.68 142904 1863532 44036 00:36:55 12:27:01 AM 1196952 2935048 2556724 68.11 2104 1904288 670996 13.97 149436 2104732 69620 00:36:55 12:28:01 AM 1062912 2957316 2690764 71.68 2104 2053912 633152 13.18 147668 2216032 23192 00:36:55 12:29:01 AM 1028336 2924612 2725340 72.60 2104 2055708 664888 13.85 149736 2249992 7600 00:36:55 12:30:01 AM 1029268 2963072 2724408 72.58 2104 2092988 624372 13.00 160380 2234960 4 00:36:55 12:31:01 AM 1028332 2962140 2725344 72.60 2104 2092992 624372 13.00 160380 2235200 4 00:36:55 12:32:01 AM 1028600 2962408 2725076 72.60 2104 2092992 624372 13.00 160380 2235240 4 00:36:55 12:33:01 AM 1031760 2965568 2721916 72.51 2104 2092996 625104 13.02 172148 2221416 8 00:36:55 12:34:01 AM 1032476 2966552 2721200 72.49 2104 2092980 618968 12.89 175416 2217236 6732 00:36:55 12:35:01 AM 1011932 2947372 2741744 73.04 2104 2094520 647236 13.48 177140 2236952 4 00:36:55 12:36:01 AM 1039316 2977448 2714360 72.31 2104 2096972 609968 12.70 361352 2026088 7536 00:36:55 Average: 1089562 2959625 2664114 70.97 2104 2031632 636376 13.25 177904 2167398 14431 00:36:55 00:36:55 12:25:01 AM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 00:36:55 12:26:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:26:01 AM eth0 227.61 123.66 1131.52 57.63 0.00 0.00 0.00 0.00 00:36:55 12:27:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:27:01 AM eth0 48.73 43.25 834.72 5.72 0.00 0.00 0.00 0.00 00:36:55 12:28:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:28:01 AM eth0 34.01 30.06 323.66 4.29 0.00 0.00 0.00 0.00 00:36:55 12:29:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:29:01 AM eth0 3.83 3.38 2.10 1.54 0.00 0.00 0.00 0.00 00:36:55 12:30:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:30:01 AM eth0 34.86 30.56 647.98 3.24 0.00 0.00 0.00 0.00 00:36:55 12:31:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:31:01 AM eth0 0.30 0.23 0.09 0.07 0.00 0.00 0.00 0.00 00:36:55 12:32:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:32:01 AM eth0 0.53 0.27 0.57 0.02 0.00 0.00 0.00 0.00 00:36:55 12:33:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:33:01 AM eth0 1.13 0.87 0.74 0.12 0.00 0.00 0.00 0.00 00:36:55 12:34:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:34:01 AM eth0 5.33 5.93 2.59 2.98 0.00 0.00 0.00 0.00 00:36:55 12:35:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:35:01 AM eth0 3.88 3.58 6.87 0.64 0.00 0.00 0.00 0.00 00:36:55 12:36:01 AM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 12:36:01 AM eth0 10.50 9.23 7.54 4.59 0.00 0.00 0.00 0.00 00:36:55 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:36:55 Average: eth0 33.70 22.82 268.94 7.35 0.00 0.00 0.00 0.00 00:36:55 00:36:55 00:36:55 ---> sar -P ALL: 00:36:55 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 09/10/2026 _x86_64_ (2 CPU) 00:36:55 00:36:55 00:24:15 LINUX RESTART (2 CPU) 00:36:55 00:36:55 12:25:01 AM CPU %user %nice %system %iowait %steal %idle 00:36:55 12:26:01 AM all 21.70 0.00 5.58 4.19 0.09 68.44 00:36:55 12:26:01 AM 0 12.10 0.00 6.09 5.79 0.08 75.93 00:36:55 12:26:01 AM 1 31.31 0.00 5.07 2.58 0.10 60.94 00:36:55 12:27:01 AM all 26.42 0.00 3.58 2.13 0.13 67.75 00:36:55 12:27:01 AM 0 21.96 0.00 3.72 2.00 0.12 72.19 00:36:55 12:27:01 AM 1 30.87 0.00 3.44 2.25 0.13 63.31 00:36:55 12:28:01 AM all 16.41 0.00 2.43 1.26 0.09 79.81 00:36:55 12:28:01 AM 0 15.83 0.00 2.42 1.55 0.12 80.08 00:36:55 12:28:01 AM 1 16.99 0.00 2.44 0.97 0.07 79.54 00:36:55 12:29:01 AM all 6.85 0.00 0.67 0.19 0.05 92.24 00:36:55 12:29:01 AM 0 5.23 0.00 0.60 0.23 0.05 93.89 00:36:55 12:29:01 AM 1 8.46 0.00 0.73 0.15 0.05 90.60 00:36:55 12:30:01 AM all 9.90 0.00 0.93 0.49 0.05 88.63 00:36:55 12:30:01 AM 0 5.21 0.00 0.65 0.43 0.05 93.65 00:36:55 12:30:01 AM 1 14.58 0.00 1.20 0.55 0.05 83.62 00:36:55 12:31:01 AM all 0.33 0.00 0.08 0.07 0.04 99.49 00:36:55 12:31:01 AM 0 0.10 0.00 0.10 0.00 0.05 99.75 00:36:55 12:31:01 AM 1 0.55 0.00 0.05 0.13 0.03 99.23 00:36:55 12:32:01 AM all 0.25 0.00 0.07 0.00 0.03 99.66 00:36:55 12:32:01 AM 0 0.02 0.00 0.05 0.00 0.02 99.92 00:36:55 12:32:01 AM 1 0.48 0.00 0.08 0.00 0.03 99.40 00:36:55 12:33:01 AM all 1.09 0.00 0.17 0.00 0.04 98.70 00:36:55 12:33:01 AM 0 0.57 0.00 0.08 0.00 0.05 99.30 00:36:55 12:33:01 AM 1 1.62 0.00 0.25 0.00 0.03 98.10 00:36:55 12:34:01 AM all 15.24 0.00 1.06 0.08 0.06 83.57 00:36:55 12:34:01 AM 0 5.61 0.00 0.82 0.02 0.03 93.52 00:36:55 12:34:01 AM 1 24.85 0.00 1.30 0.13 0.08 73.63 00:36:55 12:35:01 AM all 1.77 0.00 0.26 0.23 0.04 97.70 00:36:55 12:35:01 AM 0 2.37 0.00 0.35 0.40 0.03 96.84 00:36:55 12:35:01 AM 1 1.17 0.00 0.17 0.07 0.05 98.55 00:36:55 12:36:01 AM all 13.32 0.00 1.52 0.16 0.05 84.95 00:36:55 12:36:01 AM 0 10.61 0.00 1.74 0.28 0.05 87.32 00:36:55 12:36:01 AM 1 16.02 0.00 1.30 0.03 0.05 82.59 00:36:55 00:36:55 Average: CPU %user %nice %system %iowait %steal %idle 00:36:55 Average: all 10.29 0.00 1.48 0.80 0.06 87.36 00:36:55 Average: 0 7.24 0.00 1.51 0.97 0.06 90.22 00:36:55 Average: 1 13.35 0.00 1.46 0.62 0.06 84.51 00:36:55 00:36:55 00:36:55