15:04:38 Started by timer 15:04:38 Running as SYSTEM 15:04:38 [EnvInject] - Loading node environment variables. 15:04:38 Building remotely on prd-centos8-builder-2c-4g-2544 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 15:04:38 [ssh-agent] Looking for ssh-agent implementation... 15:04:38 $ ssh-agent 15:04:39 SSH_AUTH_SOCK=/tmp/ssh-J16UStDv05v0/agent.5179 15:04:39 SSH_AGENT_PID=5181 15:04:39 [ssh-agent] Started. 15:04:39 Running ssh-add (command line suppressed) 15:04:39 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13673691484307120264.key (jenkins-ssh) 15:04:39 [ssh-agent] Using credentials jenkins (jenkins) 15:04:39 The recommended git tool is: NONE 15:04:41 using credential jenkins 15:04:41 Wiping out workspace first. 15:04:41 Cloning the remote Git repository 15:04:41 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 15:04:41 > git init /w/workspace/ci-management-openstack-cron # timeout=10 15:04:41 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 15:04:41 > git --version # timeout=10 15:04:41 > git --version # 'git version 2.43.0' 15:04:41 using GIT_SSH to set credentials jenkins 15:04:41 [INFO] Currently running in a labeled security context 15:04:41 [INFO] Currently SELinux is 'enforcing' on the host 15:04:41 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh6184811386453560340.key 15:04:41 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 15:04:45 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 15:04:45 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 15:04:45 Avoid second fetch 15:04:45 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 15:04:45 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 15:04:45 > git config core.sparsecheckout # timeout=10 15:04:45 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 15:04:46 Commit message: "CI: Update github2gerrit caller to v2.4.4" 15:04:46 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 15:04:46 > git remote # timeout=10 15:04:46 > git submodule init # timeout=10 15:04:46 > git submodule sync # timeout=10 15:04:46 > git config --get remote.origin.url # timeout=10 15:04:46 > git submodule init # timeout=10 15:04:46 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 15:04:46 > git config --get submodule.packer/common-packer.url # timeout=10 15:04:46 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 15:04:46 > git config --get submodule.global-jjb.url # timeout=10 15:04:46 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 15:04:46 > git submodule update --init --recursive packer/common-packer # timeout=10 15:04:50 > git submodule update --init --recursive global-jjb # timeout=10 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 15:05:01 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 15:05:01 provisioning config files... 15:05:01 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 15:05:01 copy managed file [npmrc] to file:/home/jenkins/.npmrc 15:05:01 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 15:05:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5858628334287767074.sh 15:05:01 ---> python-tools-install.sh 15:05:01 Setup pyenv: 15:05:01 system 15:05:01 * 3.8.13 (set by /opt/pyenv/version) 15:05:01 * 3.9.13 (set by /opt/pyenv/version) 15:05:01 * 3.10.6 (set by /opt/pyenv/version) 15:05:06 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-5wEH 15:05:06 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 15:05:06 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:05:17 lf-activate-venv(): INFO: Installing additional packages: lftools 15:05:53 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:05:53 Generating Requirements File 15:06:37 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 15:06:37 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 15:06:37 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 15:06:38 Python 3.10.6 15:06:38 pip 26.3 from /tmp/venv-5wEH/lib/python3.10/site-packages/pip (python 3.10) 15:06:38 aiohappyeyeballs==2.7.1 15:06:38 aiohttp==3.14.5 15:06:38 aiosignal==1.4.0 15:06:38 appdirs==1.4.4 15:06:38 argcomplete==3.7.2 15:06:38 aspy.yaml==1.3.0 15:06:38 async-timeout==5.0.1 15:06:38 attrs==26.1.0 15:06:38 autopage==0.6.0 15:06:38 backports.strenum==1.3.1 15:06:38 beautifulsoup4==4.15.0 15:06:38 boto3==1.44.0 15:06:38 botocore==1.44.0 15:06:38 bs4==0.0.2 15:06:38 certifi==2026.10.23 15:06:38 cffi==2.1.1 15:06:38 cfgv==3.5.0 15:06:38 chardet==7.7.0 15:06:38 charset-normalizer==3.5.2 15:06:38 click==8.5.1 15:06:38 cliff==4.14.0 15:06:38 cmd2==3.5.1 15:06:38 cryptography==3.3.2 15:06:38 debtcollector==3.1.0 15:06:38 decorator==5.3.1 15:06:38 defusedxml==0.7.1 15:06:38 Deprecated==1.3.1 15:06:38 distlib==0.4.4 15:06:38 dnspython==2.8.0 15:06:38 docker==7.2.0 15:06:38 dogpile.cache==1.5.0 15:06:38 durationpy==0.11 15:06:38 email-validator==2.3.0 15:06:38 filelock==4.1.0 15:06:38 frozenlist==1.8.0 15:06:38 future==1.0.0 15:06:38 gitdb==4.0.12 15:06:38 GitPython==3.2.1 15:06:38 httplib2==0.30.2 15:06:38 identify==2.6.20 15:06:38 idna==3.20 15:06:38 importlib-resources==1.5.0 15:06:38 iso8601==2.1.0 15:06:38 Jinja2==3.1.6 15:06:38 jmespath==1.1.0 15:06:38 jsonpatch==1.46 15:06:38 jsonpointer==3.12 15:06:38 jsonschema==4.26.0 15:06:38 jsonschema-specifications==2025.9.1 15:06:38 keystoneauth1==5.14.0 15:06:38 kubernetes==36.0.3 15:06:38 lftools==0.37.26 15:06:38 lxml==6.1.3 15:06:38 markdown-it-py==4.3.0 15:06:38 MarkupSafe==3.0.4 15:06:38 mdurl==0.1.2 15:06:38 msgpack==1.2.4 15:06:38 multi_key_dict==2.0.4 15:06:38 multidict==7.1.0 15:06:38 munch==4.0.0 15:06:38 netaddr==1.3.0 15:06:38 niet==1.4.2 15:06:38 nodeenv==1.12.0 15:06:38 oauth2client==4.1.3 15:06:38 oauthlib==4.0.1 15:06:38 openstacksdk==4.13.0 15:06:38 os-service-types==1.8.2 15:06:38 osc-lib==4.6.0 15:06:38 oslo.config==10.4.0 15:06:38 oslo.context==6.4.0 15:06:38 oslo.i18n==6.8.0 15:06:38 oslo.log==8.2.0 15:06:38 oslo.serialization==5.10.0 15:06:38 oslo.utils==10.1.1 15:06:38 packaging==26.3 15:06:38 pbr==7.1.3 15:06:38 platformdirs==4.12.4 15:06:38 prettytable==3.18.0 15:06:38 propcache==0.5.4 15:06:38 psutil==7.2.2 15:06:38 pyasn1==0.6.5 15:06:38 pyasn1_modules==0.4.2 15:06:38 pycparser==3.11 15:06:38 pygerrit2==2.0.15 15:06:38 PyGithub==2.10.0 15:06:38 Pygments==2.21.0 15:06:38 PyJWT==2.15.1 15:06:38 PyNaCl==1.6.2 15:06:38 pyparsing==2.4.7 15:06:38 pyperclip==1.11.0 15:06:38 pyrsistent==0.20.0 15:06:38 python-cinderclient==9.9.0 15:06:38 python-dateutil==3.0.0 15:06:38 python-discovery==1.9.5 15:06:38 python-heatclient==5.2.0 15:06:38 python-jenkins==1.8.3 15:06:38 python-keystoneclient==6.0.0 15:06:38 python-magnumclient==4.11.0 15:06:38 python-openstackclient==10.0.0 15:06:38 python-swiftclient==4.11.0 15:06:38 PyYAML==6.0.3 15:06:38 referencing==0.37.0 15:06:38 requests==2.34.2 15:06:38 requests-oauthlib==2.0.0 15:06:38 rfc3986==2.0.0 15:06:38 rich==15.0.0 15:06:38 rich-argparse==1.8.0 15:06:38 rpds-py==0.30.0 15:06:38 rsa==4.9.1 15:06:38 ruamel.yaml==0.19.1 15:06:38 ruamel.yaml.clib==0.2.15 15:06:38 s3transfer==0.19.3 15:06:38 simplejson==4.3.0 15:06:38 six==1.17.0 15:06:38 smmap==5.0.3 15:06:38 soupsieve==2.10 15:06:38 stevedore==5.8.0 15:06:38 tabulate==0.10.0 15:06:38 toml==0.10.2 15:06:38 tomlkit==0.15.2 15:06:38 tqdm==4.70.1 15:06:38 typing_extensions==4.16.0 15:06:38 tzdata==2026.6 15:06:38 urllib3==1.26.20 15:06:38 virtualenv==21.15.6 15:06:38 wcwidth==0.9.4 15:06:38 websocket-client==1.9.2 15:06:38 wrapt==2.5.2 15:06:38 xdg==6.0.0 15:06:38 xmltodict==1.0.4 15:06:38 yarl==1.25.1 15:06:38 yq==4.4.5 15:06:38 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins6669172164451671423.sh 15:06:38 ---> uv-install.sh 15:06:38 Installing uv/uvx (latest) using shell installer 15:06:45 2026-11-12 15:06:45 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-JqFPOr.sh" [1] 15:06:45 downloading uv 0.13.7 x86_64-unknown-linux-gnu 15:06:49 installing to /home/jenkins/.local/bin 15:06:49 uv 15:06:49 uvx 15:06:49 everything's installed! 15:06:49 ---> Validating uv/uvx install 15:06:49 uvx 0.13.7 (x86_64-unknown-linux-gnu) 15:06:49 [EnvInject] - Injecting environment variables from a build step. 15:06:49 [EnvInject] - Injecting as environment variables the properties content 15:06:49 OS_CLOUD=vex 15:06:49 15:06:49 [EnvInject] - Variables injected successfully. 15:06:49 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 15:06:49 Run condition [Boolean condition] enabling perform for step [Execute shell] 15:06:49 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins10450119541740838297.sh 15:06:49 ---> Orphaned k8s clusters 15:06:49 Setup pyenv: 15:06:49 system 15:06:49 3.8.13 15:06:49 3.9.13 15:06:49 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:06:49 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:06:49 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:06:54 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 15:07:21 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 15:07:21 botocore 1.44.0 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 15:07:22 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:07:32 -----> Delete orphaned cluster 15:07:32 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 15:07:32 Run condition [Boolean condition] enabling perform for step [Execute shell] 15:07:32 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8252432958604165755.sh 15:07:32 ---> Orphaned stacks 15:07:32 Setup pyenv: 15:07:32 system 15:07:32 3.8.13 15:07:32 3.9.13 15:07:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:07:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:07:32 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:07:37 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 15:08:09 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:08:09 + mapfile -t OS_COE_CLUSTERS_ID 15:08:09 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 15:08:09 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 15:08:09 ++ awk '{print $1}' 15:08:18 + echo '-----> Active clusters -> stacks' 15:08:18 -----> Active clusters -> stacks 15:08:18 + OS_COE_STACKS=() 15:08:18 + [[ 0 -gt 0 ]] 15:08:18 + mapfile -t OS_STACKS 15:08:18 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 15:08:18 ++ awk '{print $1}' 15:08:27 + echo '-----> Active stacks' 15:08:27 -----> Active stacks 15:08:27 + echo '-----> Delete orphaned stacks' 15:08:27 -----> Delete orphaned stacks 15:08:27 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 15:08:27 Run condition [Boolean condition] enabling perform for step [Execute shell] 15:08:27 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17786977867439327177.sh 15:08:27 ---> Orphaned servers 15:08:27 Setup pyenv: 15:08:27 system 15:08:27 3.8.13 15:08:27 3.9.13 15:08:27 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:08:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:08:27 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:08:32 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 15:11:14 WARNING: Connection interrupted while downloading. 15:11:14 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 1) 15:11:17 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 2) 15:11:20 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 3) 15:11:23 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 4) 15:11:26 WARNING: Attempting to resume incomplete download (7.9 MB/13.4 MB, attempt 5) 15:11:29 error: incomplete-download 15:11:29 15:11:29 × Download failed after 6 attempts because not enough bytes were received (7.9 MB/13.4 MB) 15:11:29 ╰─> URL: https://nexus3.o-ran-sc.org/repository/PyPi/packages/botocore/1.37.20/botocore-1.37.20-py3-none-any.whl#sha256=c34f4f25fda7c4f726adf5a948590bd6bd7892c05278d31e344b5908e7b43301 15:11:29 15:11:29 note: This is an issue with network connectivity, not pip. 15:11:29 hint: Use --resume-retries to configure resume attempt limit. 15:11:32 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 15:15:01 Build timed out (after 10 minutes). Marking the build as failed. 15:15:01 $ ssh-agent -k 15:15:01 unset SSH_AUTH_SOCK; 15:15:01 unset SSH_AGENT_PID; 15:15:01 echo Agent pid 5181 killed; 15:15:01 [ssh-agent] Stopped. 15:15:01 Build was aborted 15:15:01 [PostBuildScript] - [INFO] Executing post build scripts. 15:15:01 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12925681472781925151.sh 15:15:01 ---> sysstat.sh 15:15:01 /home/jenkins/lf-env.sh: line 73: 6644 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 15:15:01 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 15:15:01 /tmp/jenkins17786977867439327177.sh: line 67: openstack: command not found 15:15:01 -----> Active servers 15:15:01 -----> Delete orphaned servers 15:15:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6516328284901644864.sh 15:15:02 ---> package-listing.sh 15:15:02 ++ tr '[:upper:]' '[:lower:]' 15:15:02 ++ facter osfamily 15:15:02 + OS_FAMILY=redhat 15:15:02 + workspace=/w/workspace/ci-management-openstack-cron 15:15:02 + START_PACKAGES=/tmp/packages_start.txt 15:15:02 + END_PACKAGES=/tmp/packages_end.txt 15:15:02 + DIFF_PACKAGES=/tmp/packages_diff.txt 15:15:02 + PACKAGES=/tmp/packages_start.txt 15:15:02 + '[' /w/workspace/ci-management-openstack-cron ']' 15:15:02 + PACKAGES=/tmp/packages_end.txt 15:15:02 + case "${OS_FAMILY}" in 15:15:02 + rpm -qa 15:15:02 + sort 15:15:10 + '[' -f /tmp/packages_start.txt ']' 15:15:10 + '[' -f /tmp/packages_end.txt ']' 15:15:10 + diff /tmp/packages_start.txt /tmp/packages_end.txt 15:15:10 + '[' /w/workspace/ci-management-openstack-cron ']' 15:15:10 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 15:15:10 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 15:15:10 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11843470295049994581.sh 15:15:10 ---> capture-instance-metadata.sh 15:15:10 Setup pyenv: 15:15:10 system 15:15:10 3.8.13 15:15:10 3.9.13 15:15:10 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:15:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:15:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:15:14 lf-activate-venv(): INFO: Installing additional packages: lftools 15:15:30 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:15:30 INFO: Running in OpenStack, capturing instance metadata 15:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6901335515199217562.sh 15:15:30 provisioning config files... 15:15:30 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config14126531284219274520tmp 15:15:30 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 15:15:30 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 15:15:30 [EnvInject] - Injecting environment variables from a build step. 15:15:30 [EnvInject] - Injecting as environment variables the properties content 15:15:30 SERVER_ID=logs 15:15:30 15:15:30 [EnvInject] - Variables injected successfully. 15:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins5093887578977070859.sh 15:15:30 ---> create-netrc.sh 15:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2809976261508364705.sh 15:15:30 ---> python-tools-install.sh 15:15:30 Setup pyenv: 15:15:31 system 15:15:31 3.8.13 15:15:31 3.9.13 15:15:31 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:15:31 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:15:31 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:15:36 lf-activate-venv(): INFO: Installing additional packages: lftools 15:15:51 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:15:51 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins16231452706405321307.sh 15:15:51 ---> uv-install.sh 15:15:51 uv 0.13.7 is already installed 15:15:51 uvx 0.13.7 (x86_64-unknown-linux-gnu) 15:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6233464257836431518.sh 15:15:51 ---> sudo-logs.sh 15:15:51 Archiving 'sudo' log.. 15:15:52 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins82523507806456907.sh 15:15:52 ---> job-cost.sh 15:15:52 INFO: Activating Python virtual environment... 15:15:52 Setup pyenv: 15:15:52 system 15:15:52 3.8.13 15:15:52 3.9.13 15:15:52 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:15:52 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:15:52 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:15:57 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 15:16:09 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:16:09 INFO: No stack-cost file found 15:16:09 INFO: Instance uptime: 750s 15:16:09 INFO: Fetching instance metadata (attempt 1 of 3)... 15:16:09 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 15:16:09 INFO: Successfully fetched instance metadata 15:16:09 INFO: Instance type: v3-starter-2 15:16:09 INFO: Retrieving pricing info for: v3-starter-2 15:16:09 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 15:16:09 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=750 15:16:13 INFO: Successfully fetched Vexxhost pricing API 15:16:13 INFO: Retrieved cost: 0.02 15:16:13 INFO: Retrieved resource: v3-starter-2 15:16:13 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 15:16:13 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 15:16:13 INFO: Successfully archived job cost data 15:16:13 DEBUG: Cost data: ci-management-openstack-cron,63796,2026-11-12 15:16:13,v3-starter-2,750,0.02,0.00,FAILURE 15:16:13 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17621906416235047527.sh 15:16:13 ---> logs-deploy.sh 15:16:13 Setup pyenv: 15:16:13 system 15:16:13 3.8.13 15:16:13 3.9.13 15:16:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 15:16:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-5wEH from file:/tmp/.os_lf_venv 15:16:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 15:16:18 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 15:16:33 lf-activate-venv(): INFO: Adding /tmp/venv-5wEH/bin to PATH 15:16:33 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63796 15:16:33 INFO: archiving workspace using pattern(s): 15:16:39 Archives upload complete. 15:16:39 INFO: archiving logs to Nexus 15:16:40 ---> uname -a: 15:16:40 Linux prd-centos8-builder-2c-4g-2544.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 15:16:40 15:16:40 15:16:40 ---> lscpu: 15:16:40 Architecture: x86_64 15:16:40 CPU op-mode(s): 32-bit, 64-bit 15:16:40 Byte Order: Little Endian 15:16:40 CPU(s): 2 15:16:40 On-line CPU(s) list: 0,1 15:16:40 Thread(s) per core: 1 15:16:40 Core(s) per socket: 1 15:16:40 Socket(s): 2 15:16:40 NUMA node(s): 1 15:16:40 Vendor ID: AuthenticAMD 15:16:40 CPU family: 23 15:16:40 Model: 49 15:16:40 Model name: AMD EPYC-Rome Processor 15:16:40 Stepping: 0 15:16:40 CPU MHz: 2799.998 15:16:40 BogoMIPS: 5599.99 15:16:40 Virtualization: AMD-V 15:16:40 Hypervisor vendor: KVM 15:16:40 Virtualization type: full 15:16:40 L1d cache: 32K 15:16:40 L1i cache: 32K 15:16:40 L2 cache: 512K 15:16:40 L3 cache: 16384K 15:16:40 NUMA node0 CPU(s): 0,1 15:16:40 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 15:16:40 15:16:40 15:16:40 ---> nproc: 15:16:40 2 15:16:40 15:16:40 15:16:40 ---> df -h: 15:16:40 Filesystem Size Used Avail Use% Mounted on 15:16:40 devtmpfs 1.8G 0 1.8G 0% /dev 15:16:40 tmpfs 1.8G 0 1.8G 0% /dev/shm 15:16:40 tmpfs 1.8G 17M 1.8G 1% /run 15:16:40 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 15:16:40 /dev/vda1 20G 15G 5.4G 74% / 15:16:40 tmpfs 367M 0 367M 0% /run/user/1001 15:16:40 15:16:40 15:16:40 ---> free -m: 15:16:40 total used free shared buff/cache available 15:16:40 Mem: 3665 485 1232 17 1947 2877 15:16:40 Swap: 1023 1 1022 15:16:40 15:16:40 15:16:40 ---> ip addr: 15:16:40 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 15:16:40 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 15:16:40 inet 127.0.0.1/8 scope host lo 15:16:40 valid_lft forever preferred_lft forever 15:16:40 inet6 ::1/128 scope host 15:16:40 valid_lft forever preferred_lft forever 15:16:40 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 15:16:40 link/ether fa:16:3e:35:51:14 brd ff:ff:ff:ff:ff:ff 15:16:40 altname enp0s3 15:16:40 altname ens3 15:16:40 inet 10.32.7.224/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 15:16:40 valid_lft 85651sec preferred_lft 85651sec 15:16:40 inet6 fe80::f816:3eff:fe35:5114/64 scope link 15:16:40 valid_lft forever preferred_lft forever 15:16:40 15:16:40 15:16:40 ---> sar -b -r -n DEV: 15:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 15:16:40 15:16:40 15:03:47 LINUX RESTART (2 CPU) 15:16:40 15:16:40 03:05:01 PM tps rtps wtps bread/s bwrtn/s 15:16:40 03:06:01 PM 54.10 6.16 47.93 927.02 5065.79 15:16:40 03:07:01 PM 66.53 0.75 65.78 202.07 9391.32 15:16:40 03:08:01 PM 42.99 0.47 42.53 60.12 12061.76 15:16:40 03:09:01 PM 40.82 0.05 40.77 1.33 18066.21 15:16:40 03:10:00 PM 118.42 1.51 116.90 182.69 171383.01 15:16:40 03:10:01 PM 418.03 84.43 333.61 13232.79 519721.31 15:16:40 03:11:01 PM 112.33 2.58 109.75 300.43 152429.67 15:16:40 03:12:01 PM 54.28 2.67 51.62 383.07 36937.99 15:16:40 03:13:01 PM 84.51 0.28 84.22 103.70 2108.38 15:16:40 03:14:01 PM 73.64 0.05 73.59 1.60 2017.25 15:16:40 03:15:01 PM 82.26 3.57 78.69 319.49 2085.75 15:16:40 03:16:01 PM 108.48 87.07 21.41 7763.45 718.64 15:16:40 Average: 76.77 9.71 67.05 955.60 38124.78 15:16:40 15:16:40 03:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 15:16:40 03:06:01 PM 1364392 3011392 2389284 63.65 2104 1815824 616948 12.85 136296 1964952 138032 15:16:40 03:07:01 PM 1042356 2948644 2711320 72.23 2104 2065724 651068 13.56 138880 2247076 161324 15:16:40 03:08:01 PM 786684 2853064 2966992 79.04 2104 2224736 735492 15.32 155092 2481232 77192 15:16:40 03:09:01 PM 274992 2844208 3478684 92.67 2104 2726996 750388 15.63 184692 2960220 187076 15:16:40 03:10:00 PM 121264 2807500 3632412 96.77 2104 2839584 797104 16.60 247640 3063020 239124 15:16:40 03:10:01 PM 132992 2809836 3620684 96.46 2104 2829720 797104 16.60 240880 3061352 14704 15:16:40 03:11:01 PM 159380 2782564 3594296 95.75 2104 2769712 856908 17.84 289396 3008232 174328 15:16:40 03:12:01 PM 1575196 2902836 2178480 58.04 2104 1476828 744736 15.51 182820 1703080 1556 15:16:40 03:13:01 PM 1517244 2872316 2236432 59.58 2104 1499448 752964 15.68 191408 1737380 4708 15:16:40 03:14:01 PM 1452000 2826912 2301676 61.32 2104 1515436 790764 16.47 197800 1784044 3640 15:16:40 03:15:01 PM 1614896 3015740 2138780 56.98 2104 1541388 650384 13.54 205964 1599740 3580 15:16:40 03:16:01 PM 1334860 2977620 2418816 64.44 2104 1782164 625072 13.02 220856 1858948 4348 15:16:40 Average: 948021 2887719 2805655 74.74 2104 2090630 730744 15.22 199310 2289106 84134 15:16:40 15:16:40 03:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 15:16:40 03:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:06:01 PM eth0 47.32 41.44 885.81 4.74 0.00 0.00 0.00 0.00 15:16:40 03:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:07:01 PM eth0 66.78 56.01 1022.54 7.14 0.00 0.00 0.00 0.00 15:16:40 03:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:08:01 PM eth0 45.91 38.18 741.77 5.90 0.00 0.00 0.00 0.00 15:16:40 03:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:09:01 PM eth0 243.74 182.42 4540.51 14.92 0.00 0.00 0.00 0.00 15:16:40 03:10:00 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:10:00 PM eth0 2285.46 1690.94 43542.04 114.82 0.00 0.00 0.00 0.00 15:16:40 03:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:10:01 PM eth0 1614.75 1197.54 31877.35 79.58 0.00 0.00 0.00 0.00 15:16:40 03:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:11:01 PM eth0 1881.06 1367.99 39614.69 93.19 0.00 0.00 0.00 0.00 15:16:40 03:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:12:01 PM eth0 372.61 247.03 7764.04 20.41 0.00 0.00 0.00 0.00 15:16:40 03:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:13:01 PM eth0 53.85 36.17 122.46 12.69 0.00 0.00 0.00 0.00 15:16:40 03:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:14:01 PM eth0 41.93 29.80 100.92 10.36 0.00 0.00 0.00 0.00 15:16:40 03:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:15:01 PM eth0 48.80 33.74 107.43 12.08 0.00 0.00 0.00 0.00 15:16:40 03:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 03:16:01 PM eth0 11.83 11.43 8.59 5.65 0.00 0.00 0.00 0.00 15:16:40 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 15:16:40 Average: eth0 462.36 338.67 8929.17 27.38 0.00 0.00 0.00 0.00 15:16:40 15:16:40 15:16:40 ---> sar -P ALL: 15:16:40 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/12/2026 _x86_64_ (2 CPU) 15:16:40 15:16:40 15:03:47 LINUX RESTART (2 CPU) 15:16:40 15:16:40 03:05:01 PM CPU %user %nice %system %iowait %steal %idle 15:16:40 03:06:01 PM all 24.07 0.00 3.36 1.46 0.08 71.02 15:16:40 03:06:01 PM 0 29.55 0.00 3.88 1.37 0.08 65.12 15:16:40 03:06:01 PM 1 18.59 0.00 2.84 1.55 0.08 76.93 15:16:40 03:07:01 PM all 23.98 0.00 3.46 2.08 0.08 70.41 15:16:40 03:07:01 PM 0 31.98 0.00 3.25 1.68 0.08 63.00 15:16:40 03:07:01 PM 1 15.96 0.00 3.66 2.47 0.07 77.84 15:16:40 03:08:01 PM all 30.08 0.00 2.71 1.64 0.09 65.47 15:16:40 03:08:01 PM 0 54.48 0.00 3.35 1.05 0.12 41.01 15:16:40 03:08:01 PM 1 5.63 0.00 2.07 2.24 0.07 89.99 15:16:40 03:09:01 PM all 24.16 0.00 3.45 0.96 0.07 71.36 15:16:40 03:09:01 PM 0 22.30 0.00 2.97 1.00 0.07 73.66 15:16:40 03:09:01 PM 1 26.03 0.00 3.94 0.92 0.07 69.05 15:16:40 03:10:00 PM all 22.70 0.00 12.73 2.83 0.14 61.60 15:16:40 03:10:00 PM 0 23.83 0.00 11.74 2.71 0.14 61.58 15:16:40 03:10:00 PM 1 21.54 0.00 13.75 2.96 0.14 61.62 15:16:40 03:10:01 PM all 17.57 0.00 17.15 12.13 0.42 52.72 15:16:40 03:10:01 PM 0 15.57 0.00 16.39 10.66 0.82 56.56 15:16:40 03:10:01 PM 1 19.66 0.00 17.95 13.68 0.00 48.72 15:16:40 03:11:01 PM all 23.14 0.00 11.88 2.72 0.71 61.55 15:16:40 03:11:01 PM 0 18.47 0.00 9.69 2.65 0.62 68.58 15:16:40 03:11:01 PM 1 27.91 0.00 14.11 2.80 0.80 54.38 15:16:40 03:12:01 PM all 21.75 0.00 3.66 1.30 0.51 72.78 15:16:40 03:12:01 PM 0 29.38 0.00 3.18 1.22 0.52 65.70 15:16:40 03:12:01 PM 1 14.07 0.00 4.15 1.38 0.50 79.90 15:16:40 03:13:01 PM all 39.46 0.00 1.58 0.37 0.12 58.47 15:16:40 03:13:01 PM 0 58.51 0.00 2.02 0.60 0.13 38.74 15:16:40 03:13:01 PM 1 20.33 0.00 1.14 0.13 0.10 78.30 15:16:40 03:14:01 PM all 41.17 0.00 1.33 0.33 0.11 57.05 15:16:40 03:14:01 PM 0 74.97 0.00 1.78 0.62 0.15 22.48 15:16:40 03:14:01 PM 1 7.22 0.00 0.87 0.05 0.07 91.79 15:16:40 03:15:01 PM all 40.59 0.00 1.53 0.59 0.12 57.17 15:16:40 03:15:01 PM 0 66.61 0.00 1.92 1.07 0.15 30.25 15:16:40 03:15:01 PM 1 14.48 0.00 1.14 0.12 0.08 84.18 15:16:40 15:16:40 03:15:01 PM CPU %user %nice %system %iowait %steal %idle 15:16:40 03:16:01 PM all 23.36 0.00 2.66 6.02 0.08 67.89 15:16:40 03:16:01 PM 0 24.65 0.00 2.70 4.31 0.07 68.28 15:16:40 03:16:01 PM 1 22.07 0.00 2.63 7.73 0.08 67.49 15:16:40 Average: all 28.59 0.00 4.38 1.86 0.19 64.97 15:16:40 Average: 0 39.52 0.00 4.23 1.67 0.19 54.38 15:16:40 Average: 1 17.59 0.00 4.54 2.05 0.19 75.63 15:16:40 15:16:40 15:16:40