19:04:38 Started by timer 19:04:38 Running as SYSTEM 19:04:38 [EnvInject] - Loading node environment variables. 19:04:38 Building remotely on prd-centos8-builder-2c-4g-2255 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron 19:04:38 [ssh-agent] Looking for ssh-agent implementation... 19:04:38 $ ssh-agent 19:04:38 SSH_AUTH_SOCK=/tmp/ssh-B8TKWgVii1bT/agent.5188 19:04:38 SSH_AGENT_PID=5190 19:04:38 [ssh-agent] Started. 19:04:38 Running ssh-add (command line suppressed) 19:04:38 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_6519740829387067542.key (jenkins-ssh) 19:04:38 [ssh-agent] Using credentials jenkins (jenkins) 19:04:38 The recommended git tool is: NONE 19:04:40 using credential jenkins 19:04:40 Wiping out workspace first. 19:04:40 Cloning the remote Git repository 19:04:41 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 19:04:41 > git init /w/workspace/ci-management-openstack-cron # timeout=10 19:04:41 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 19:04:41 > git --version # timeout=10 19:04:41 > git --version # 'git version 2.43.0' 19:04:41 using GIT_SSH to set credentials jenkins 19:04:41 [INFO] Currently running in a labeled security context 19:04:41 [INFO] Currently SELinux is 'enforcing' on the host 19:04:41 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh17400986210001075774.key 19:04:41 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 19:04:44 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 19:04:44 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 19:04:45 Avoid second fetch 19:04:45 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 19:04:45 Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master) 19:04:45 > git config core.sparsecheckout # timeout=10 19:04:45 > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 19:04:45 Commit message: "CI: Update github2gerrit caller to v2.4.4" 19:04:45 > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10 19:04:45 > git remote # timeout=10 19:04:45 > git submodule init # timeout=10 19:04:45 > git submodule sync # timeout=10 19:04:45 > git config --get remote.origin.url # timeout=10 19:04:45 > git submodule init # timeout=10 19:04:46 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 19:04:46 > git config --get submodule.packer/common-packer.url # timeout=10 19:04:46 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 19:04:46 > git config --get submodule.global-jjb.url # timeout=10 19:04:46 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 19:04:46 > git submodule update --init --recursive packer/common-packer # timeout=10 19:04:50 > git submodule update --init --recursive global-jjb # timeout=10 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:00 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 19:05:00 provisioning config files... 19:05:00 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 19:05:00 copy managed file [npmrc] to file:/home/jenkins/.npmrc 19:05:00 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 19:05:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6016836924207555657.sh 19:05:00 ---> python-tools-install.sh 19:05:00 Setup pyenv: 19:05:01 system 19:05:01 * 3.8.13 (set by /opt/pyenv/version) 19:05:01 * 3.9.13 (set by /opt/pyenv/version) 19:05:01 * 3.10.6 (set by /opt/pyenv/version) 19:05:05 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-uKnT 19:05:05 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 19:05:05 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:05:17 lf-activate-venv(): INFO: Installing additional packages: lftools 19:05:52 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:05:52 Generating Requirements File 19:06:34 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:06:34 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 19:06:34 httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible. 19:06:35 Python 3.10.6 19:06:35 pip 26.3 from /tmp/venv-uKnT/lib/python3.10/site-packages/pip (python 3.10) 19:06:35 aiohappyeyeballs==2.7.1 19:06:35 aiohttp==3.14.5 19:06:35 aiosignal==1.4.0 19:06:35 appdirs==1.4.4 19:06:35 argcomplete==3.7.2 19:06:35 aspy.yaml==1.3.0 19:06:35 async-timeout==5.0.1 19:06:35 attrs==26.1.0 19:06:35 autopage==0.6.0 19:06:35 backports.strenum==1.3.1 19:06:35 beautifulsoup4==4.15.0 19:06:35 boto3==1.43.126 19:06:35 botocore==1.43.126 19:06:35 bs4==0.0.2 19:06:35 certifi==2026.10.23 19:06:35 cffi==2.1.1 19:06:35 cfgv==3.5.0 19:06:35 chardet==7.7.0 19:06:35 charset-normalizer==3.5.2 19:06:35 click==8.5.1 19:06:35 cliff==4.14.0 19:06:35 cmd2==3.5.1 19:06:35 cryptography==3.3.2 19:06:35 debtcollector==3.1.0 19:06:35 decorator==5.3.1 19:06:35 defusedxml==0.7.1 19:06:35 Deprecated==1.3.1 19:06:35 distlib==0.4.4 19:06:35 dnspython==2.8.0 19:06:35 docker==7.2.0 19:06:35 dogpile.cache==1.5.0 19:06:35 durationpy==0.11 19:06:35 email-validator==2.3.0 19:06:35 filelock==4.1.0 19:06:35 frozenlist==1.8.0 19:06:35 future==1.0.0 19:06:35 gitdb==4.0.12 19:06:35 GitPython==3.2.1 19:06:35 httplib2==0.30.2 19:06:35 identify==2.6.20 19:06:35 idna==3.20 19:06:35 importlib-resources==1.5.0 19:06:35 iso8601==2.1.0 19:06:35 Jinja2==3.1.6 19:06:35 jmespath==1.1.0 19:06:35 jsonpatch==1.44 19:06:35 jsonpointer==3.10 19:06:35 jsonschema==4.26.0 19:06:35 jsonschema-specifications==2025.9.1 19:06:35 keystoneauth1==5.14.0 19:06:35 kubernetes==36.0.3 19:06:35 lftools==0.37.26 19:06:35 lxml==6.1.3 19:06:35 markdown-it-py==4.2.0 19:06:35 MarkupSafe==3.0.4 19:06:35 mdurl==0.1.2 19:06:35 msgpack==1.2.4 19:06:35 multi_key_dict==2.0.4 19:06:35 multidict==7.1.0 19:06:35 munch==4.0.0 19:06:35 netaddr==1.3.0 19:06:35 niet==1.4.2 19:06:35 nodeenv==1.12.0 19:06:35 oauth2client==4.1.3 19:06:35 oauthlib==4.0.1 19:06:35 openstacksdk==4.13.0 19:06:35 os-service-types==1.8.2 19:06:35 osc-lib==4.6.0 19:06:35 oslo.config==10.4.0 19:06:35 oslo.context==6.4.0 19:06:35 oslo.i18n==6.8.0 19:06:35 oslo.log==8.2.0 19:06:35 oslo.serialization==5.10.0 19:06:35 oslo.utils==10.1.1 19:06:35 packaging==26.3 19:06:35 pbr==7.1.3 19:06:35 platformdirs==4.12.4 19:06:35 prettytable==3.18.0 19:06:35 propcache==0.5.4 19:06:35 psutil==7.2.2 19:06:35 pyasn1==0.6.5 19:06:35 pyasn1_modules==0.4.2 19:06:35 pycparser==3.11 19:06:35 pygerrit2==2.0.15 19:06:35 PyGithub==2.10.0 19:06:35 Pygments==2.21.0 19:06:35 PyJWT==2.15.1 19:06:35 PyNaCl==1.6.2 19:06:35 pyparsing==2.4.7 19:06:35 pyperclip==1.11.0 19:06:35 pyrsistent==0.20.0 19:06:35 python-cinderclient==9.9.0 19:06:35 python-dateutil==3.0.0 19:06:35 python-discovery==1.9.5 19:06:35 python-heatclient==5.2.0 19:06:35 python-jenkins==1.8.3 19:06:35 python-keystoneclient==6.0.0 19:06:35 python-magnumclient==4.11.0 19:06:35 python-openstackclient==10.0.0 19:06:35 python-swiftclient==4.11.0 19:06:35 PyYAML==6.0.3 19:06:35 referencing==0.37.0 19:06:35 requests==2.34.2 19:06:35 requests-oauthlib==2.0.0 19:06:35 rfc3986==2.0.0 19:06:35 rich==15.0.0 19:06:35 rich-argparse==1.8.0 19:06:35 rpds-py==0.30.0 19:06:35 rsa==4.9.1 19:06:35 ruamel.yaml==0.19.1 19:06:35 ruamel.yaml.clib==0.2.15 19:06:35 s3transfer==0.19.3 19:06:35 simplejson==4.2.0 19:06:35 six==1.17.0 19:06:35 smmap==5.0.3 19:06:35 soupsieve==2.10 19:06:35 stevedore==5.8.0 19:06:35 tabulate==0.10.0 19:06:35 toml==0.10.2 19:06:35 tomlkit==0.15.2 19:06:35 tqdm==4.70.1 19:06:35 typing_extensions==4.16.0 19:06:35 tzdata==2026.6 19:06:35 urllib3==1.26.20 19:06:35 virtualenv==21.15.6 19:06:35 wcwidth==0.9.4 19:06:35 websocket-client==1.9.2 19:06:35 wrapt==2.5.2 19:06:35 xdg==6.0.0 19:06:35 xmltodict==1.0.4 19:06:35 yarl==1.25.1 19:06:35 yq==4.4.5 19:06:35 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13088846141674130818.sh 19:06:35 ---> uv-install.sh 19:06:35 Installing uv/uvx (latest) using shell installer 19:06:42 2026-11-08 19:06:42 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-CNrQBf.sh" [1] 19:06:42 downloading uv 0.13.7 x86_64-unknown-linux-gnu 19:06:46 installing to /home/jenkins/.local/bin 19:06:46 uv 19:06:46 uvx 19:06:46 everything's installed! 19:06:46 ---> Validating uv/uvx install 19:06:46 uvx 0.13.7 (x86_64-unknown-linux-gnu) 19:06:46 [EnvInject] - Injecting environment variables from a build step. 19:06:46 [EnvInject] - Injecting as environment variables the properties content 19:06:46 OS_CLOUD=vex 19:06:46 19:06:46 [EnvInject] - Variables injected successfully. 19:06:46 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:06:46 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:06:46 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins2138459372491966781.sh 19:06:46 ---> Orphaned k8s clusters 19:06:46 Setup pyenv: 19:06:46 system 19:06:46 3.8.13 19:06:46 3.9.13 19:06:46 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:06:46 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:06:46 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:06:51 lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 19:07:18 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:07:18 botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible. 19:07:18 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:07:28 -----> Delete orphaned cluster 19:07:28 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:07:28 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:07:28 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins4656369870379342372.sh 19:07:28 ---> Orphaned stacks 19:07:28 Setup pyenv: 19:07:28 system 19:07:28 3.8.13 19:07:28 3.9.13 19:07:28 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:07:29 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:07:29 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:07:34 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 19:08:05 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:08:05 + mapfile -t OS_COE_CLUSTERS_ID 19:08:05 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 19:08:05 ++ awk '{print $1}' 19:08:05 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 19:08:15 + echo '-----> Active clusters -> stacks' 19:08:15 -----> Active clusters -> stacks 19:08:15 + OS_COE_STACKS=() 19:08:15 + [[ 0 -gt 0 ]] 19:08:15 + mapfile -t OS_STACKS 19:08:15 ++ awk '{print $1}' 19:08:15 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 19:08:23 + echo '-----> Active stacks' 19:08:23 -----> Active stacks 19:08:23 + echo '-----> Delete orphaned stacks' 19:08:23 -----> Delete orphaned stacks 19:08:23 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:08:23 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:08:23 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16885300626070188630.sh 19:08:23 ---> Orphaned servers 19:08:23 Setup pyenv: 19:08:23 system 19:08:23 3.8.13 19:08:23 3.9.13 19:08:23 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:08:24 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:08:24 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:08:29 lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 19:11:07 WARNING: Connection interrupted while downloading. 19:11:07 WARNING: Attempting to resume incomplete download (11.3 MB/13.4 MB, attempt 1) 19:11:10 WARNING: Connection interrupted while downloading. 19:11:10 WARNING: Attempting to resume incomplete download (11.3 MB/13.4 MB, attempt 2) 19:11:13 WARNING: Connection interrupted while downloading. 19:11:13 WARNING: Attempting to resume incomplete download (11.3 MB/13.4 MB, attempt 3) 19:11:16 WARNING: Connection interrupted while downloading. 19:11:16 WARNING: Attempting to resume incomplete download (11.3 MB/13.4 MB, attempt 4) 19:11:19 WARNING: Connection interrupted while downloading. 19:11:19 WARNING: Attempting to resume incomplete download (11.3 MB/13.4 MB, attempt 5) 19:11:22 WARNING: Connection interrupted while downloading. 19:11:22 error: incomplete-download 19:11:22 19:11:22 × Download failed after 6 attempts because not enough bytes were received (11.3 MB/13.4 MB) 19:11:22 ╰─> URL: https://nexus3.o-ran-sc.org/repository/PyPi/packages/botocore/1.37.18/botocore-1.37.18-py3-none-any.whl#sha256=a8b97d217d82b3c4f6bcc906e264df7ebb51e2c6a62b3548a97cd173fb8759a1 19:11:22 19:11:22 note: This is an issue with network connectivity, not pip. 19:11:22 hint: Use --resume-retries to configure resume attempt limit. 19:11:24 lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple 19:15:00 Build timed out (after 10 minutes). Marking the build as failed. 19:15:00 $ ssh-agent -k 19:15:00 unset SSH_AUTH_SOCK; 19:15:00 unset SSH_AGENT_PID; 19:15:00 echo Agent pid 5190 killed; 19:15:00 [ssh-agent] Stopped. 19:15:00 Build was aborted 19:15:00 [PostBuildScript] - [INFO] Executing post build scripts. 19:15:00 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12588076653782391761.sh 19:15:00 ---> sysstat.sh 19:15:00 /home/jenkins/lf-env.sh: line 73: 6653 Terminated "$venv_python" -m pip install --index-url "$upstream" "$@" 19:15:00 lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 19:15:00 /tmp/jenkins16885300626070188630.sh: line 67: openstack: command not found 19:15:00 -----> Active servers 19:15:00 -----> Delete orphaned servers 19:15:02 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13457750285045432716.sh 19:15:02 ---> package-listing.sh 19:15:02 ++ facter osfamily 19:15:02 ++ tr '[:upper:]' '[:lower:]' 19:15:02 + OS_FAMILY=redhat 19:15:02 + workspace=/w/workspace/ci-management-openstack-cron 19:15:02 + START_PACKAGES=/tmp/packages_start.txt 19:15:02 + END_PACKAGES=/tmp/packages_end.txt 19:15:02 + DIFF_PACKAGES=/tmp/packages_diff.txt 19:15:02 + PACKAGES=/tmp/packages_start.txt 19:15:02 + '[' /w/workspace/ci-management-openstack-cron ']' 19:15:02 + PACKAGES=/tmp/packages_end.txt 19:15:02 + case "${OS_FAMILY}" in 19:15:02 + rpm -qa 19:15:02 + sort 19:15:09 + '[' -f /tmp/packages_start.txt ']' 19:15:09 + '[' -f /tmp/packages_end.txt ']' 19:15:09 + diff /tmp/packages_start.txt /tmp/packages_end.txt 19:15:09 + '[' /w/workspace/ci-management-openstack-cron ']' 19:15:09 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 19:15:09 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 19:15:09 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3619325732477678319.sh 19:15:09 ---> capture-instance-metadata.sh 19:15:09 Setup pyenv: 19:15:10 system 19:15:10 3.8.13 19:15:10 3.9.13 19:15:10 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:15:10 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:15:10 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:15:14 lf-activate-venv(): INFO: Installing additional packages: lftools 19:15:29 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:15:29 INFO: Running in OpenStack, capturing instance metadata 19:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10692357448810147307.sh 19:15:30 provisioning config files... 19:15:30 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config6799781555655990948tmp 19:15:30 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 19:15:30 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 19:15:30 [EnvInject] - Injecting environment variables from a build step. 19:15:30 [EnvInject] - Injecting as environment variables the properties content 19:15:30 SERVER_ID=logs 19:15:30 19:15:30 [EnvInject] - Variables injected successfully. 19:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1565246874821994036.sh 19:15:30 ---> create-netrc.sh 19:15:30 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18026254114101946590.sh 19:15:30 ---> python-tools-install.sh 19:15:30 Setup pyenv: 19:15:30 system 19:15:30 3.8.13 19:15:30 3.9.13 19:15:30 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:15:30 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:15:30 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:15:35 lf-activate-venv(): INFO: Installing additional packages: lftools 19:15:50 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:15:50 [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins3021558488689015043.sh 19:15:50 ---> uv-install.sh 19:15:51 uv 0.13.7 is already installed 19:15:51 uvx 0.13.7 (x86_64-unknown-linux-gnu) 19:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4569967053030879358.sh 19:15:51 ---> sudo-logs.sh 19:15:51 Archiving 'sudo' log.. 19:15:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6777247275897038743.sh 19:15:51 ---> job-cost.sh 19:15:51 INFO: Activating Python virtual environment... 19:15:51 Setup pyenv: 19:15:51 system 19:15:51 3.8.13 19:15:51 3.9.13 19:15:51 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:15:51 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:15:51 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:15:56 lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 19:16:08 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:16:08 INFO: No stack-cost file found 19:16:08 INFO: Instance uptime: 750s 19:16:08 INFO: Fetching instance metadata (attempt 1 of 3)... 19:16:08 DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type 19:16:09 INFO: Successfully fetched instance metadata 19:16:09 INFO: Instance type: v3-starter-2 19:16:09 INFO: Retrieving pricing info for: v3-starter-2 19:16:09 INFO: Fetching Vexxhost pricing API (attempt 1 of 3)... 19:16:09 DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=750 19:16:12 INFO: Successfully fetched Vexxhost pricing API 19:16:12 INFO: Retrieved cost: 0.02 19:16:12 INFO: Retrieved resource: v3-starter-2 19:16:12 INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost 19:16:12 INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv 19:16:12 INFO: Successfully archived job cost data 19:16:12 DEBUG: Cost data: ci-management-openstack-cron,63704,2026-11-08 19:16:12,v3-starter-2,750,0.02,0.00,FAILURE 19:16:12 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1920269154196042729.sh 19:16:12 ---> logs-deploy.sh 19:16:12 Setup pyenv: 19:16:13 system 19:16:13 3.8.13 19:16:13 3.9.13 19:16:13 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:16:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-uKnT from file:/tmp/.os_lf_venv 19:16:13 lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv) 19:16:18 lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 19:16:35 lf-activate-venv(): INFO: Adding /tmp/venv-uKnT/bin to PATH 19:16:35 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63704 19:16:35 INFO: archiving workspace using pattern(s): 19:16:40 Archives upload complete. 19:16:40 INFO: archiving logs to Nexus 19:16:41 ---> uname -a: 19:16:41 Linux prd-centos8-builder-2c-4g-2255.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 19:16:41 19:16:41 19:16:41 ---> lscpu: 19:16:41 Architecture: x86_64 19:16:41 CPU op-mode(s): 32-bit, 64-bit 19:16:41 Byte Order: Little Endian 19:16:41 CPU(s): 2 19:16:41 On-line CPU(s) list: 0,1 19:16:41 Thread(s) per core: 1 19:16:41 Core(s) per socket: 1 19:16:41 Socket(s): 2 19:16:41 NUMA node(s): 1 19:16:41 Vendor ID: AuthenticAMD 19:16:41 CPU family: 23 19:16:41 Model: 49 19:16:41 Model name: AMD EPYC-Rome Processor 19:16:41 Stepping: 0 19:16:41 CPU MHz: 2799.998 19:16:41 BogoMIPS: 5599.99 19:16:41 Virtualization: AMD-V 19:16:41 Hypervisor vendor: KVM 19:16:41 Virtualization type: full 19:16:41 L1d cache: 32K 19:16:41 L1i cache: 32K 19:16:41 L2 cache: 512K 19:16:41 L3 cache: 16384K 19:16:41 NUMA node0 CPU(s): 0,1 19:16:41 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 19:16:41 19:16:41 19:16:41 ---> nproc: 19:16:41 2 19:16:41 19:16:41 19:16:41 ---> df -h: 19:16:41 Filesystem Size Used Avail Use% Mounted on 19:16:41 devtmpfs 1.8G 0 1.8G 0% /dev 19:16:41 tmpfs 1.8G 0 1.8G 0% /dev/shm 19:16:41 tmpfs 1.8G 17M 1.8G 1% /run 19:16:41 tmpfs 1.8G 0 1.8G 0% /sys/fs/cgroup 19:16:41 /dev/vda1 20G 15G 5.4G 74% / 19:16:41 tmpfs 367M 0 367M 0% /run/user/1001 19:16:41 19:16:41 19:16:41 ---> free -m: 19:16:41 total used free shared buff/cache available 19:16:41 Mem: 3665 461 1241 17 1962 2907 19:16:41 Swap: 1023 0 1023 19:16:41 19:16:41 19:16:41 ---> ip addr: 19:16:41 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 19:16:41 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 19:16:41 inet 127.0.0.1/8 scope host lo 19:16:41 valid_lft forever preferred_lft forever 19:16:41 inet6 ::1/128 scope host 19:16:41 valid_lft forever preferred_lft forever 19:16:41 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 19:16:41 link/ether fa:16:3e:4a:fd:d7 brd ff:ff:ff:ff:ff:ff 19:16:41 altname enp0s3 19:16:41 altname ens3 19:16:41 inet 10.32.6.121/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 19:16:41 valid_lft 85650sec preferred_lft 85650sec 19:16:41 inet6 fe80::f816:3eff:fe4a:fdd7/64 scope link 19:16:41 valid_lft forever preferred_lft forever 19:16:41 19:16:41 19:16:41 ---> sar -b -r -n DEV: 19:16:41 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 19:16:41 19:16:41 19:03:47 LINUX RESTART (2 CPU) 19:16:41 19:16:41 07:05:01 PM tps rtps wtps bread/s bwrtn/s 19:16:41 07:06:01 PM 56.63 6.10 50.53 925.69 5225.76 19:16:41 07:07:01 PM 64.68 0.72 63.96 201.53 11648.52 19:16:41 07:08:01 PM 37.34 0.50 36.84 60.66 9555.12 19:16:41 07:09:01 PM 45.73 0.23 45.49 42.51 26875.25 19:16:41 07:10:01 PM 113.76 1.48 112.28 159.79 164166.90 19:16:41 07:11:01 PM 125.26 3.56 121.70 285.36 169097.25 19:16:41 07:12:01 PM 48.49 2.93 45.56 407.80 25289.69 19:16:41 07:13:01 PM 69.29 0.05 69.24 1.60 1696.25 19:16:41 07:14:01 PM 66.72 0.22 66.51 82.65 1755.96 19:16:41 07:15:01 PM 70.84 6.30 64.54 356.87 1665.12 19:16:41 07:16:01 PM 104.27 84.36 19.91 7804.07 654.10 19:16:41 Average: 73.00 9.68 63.33 938.95 37975.78 19:16:41 19:16:41 07:05:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 19:16:41 07:06:01 PM 1405980 3055928 2347704 62.54 2104 1818596 564372 11.75 136228 1923068 137956 19:16:41 07:07:01 PM 1054672 2963784 2699012 71.90 2104 2068356 628940 13.10 138424 2232324 88940 19:16:41 07:08:01 PM 701724 2835992 3051960 81.31 2104 2289196 751828 15.66 160208 2552328 140644 19:16:41 07:09:01 PM 118364 2866892 3635320 96.85 2104 2907072 722828 15.05 190176 3113632 236132 19:16:41 07:10:01 PM 134200 2827816 3619484 96.42 2104 2846772 776504 16.17 244476 3050296 144052 19:16:41 07:11:01 PM 115152 2801756 3638532 96.93 2104 2833104 829328 17.27 294480 3046652 200940 19:16:41 07:12:01 PM 1574200 2926552 2179484 58.06 2104 1501772 712116 14.83 184028 1702928 1804 19:16:41 07:13:01 PM 1531716 2904380 2221968 59.19 2104 1518072 719476 14.98 190652 1726956 3580 19:16:41 07:14:01 PM 1468568 2862068 2285116 60.88 2104 1535324 757016 15.76 197084 1772184 3428 19:16:41 07:15:01 PM 1622128 3042932 2131556 56.79 2104 1559172 628104 13.08 205024 1598736 3392 19:16:41 07:16:01 PM 1346540 3010616 2407144 64.13 2104 1801476 595276 12.40 220156 1855156 8848 19:16:41 Average: 1006659 2918065 2747025 73.18 2104 2061719 698708 14.55 196449 2234024 88156 19:16:41 19:16:41 07:05:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 19:16:41 07:06:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:06:01 PM eth0 46.45 41.42 891.50 4.73 0.00 0.00 0.00 0.00 19:16:41 07:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:07:01 PM eth0 72.94 62.68 1026.44 7.78 0.00 0.00 0.00 0.00 19:16:41 07:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:08:01 PM eth0 41.59 38.53 738.12 5.75 0.00 0.00 0.00 0.00 19:16:41 07:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:09:01 PM eth0 338.71 263.62 7192.78 20.63 0.00 0.00 0.00 0.00 19:16:41 07:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:10:01 PM eth0 1860.70 1419.52 40337.66 96.20 0.00 0.00 0.00 0.00 19:16:41 07:11:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:11:01 PM eth0 2015.17 1549.04 42959.31 105.69 0.00 0.00 0.00 0.00 19:16:41 07:12:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:12:01 PM eth0 262.57 181.34 4707.81 16.06 0.00 0.00 0.00 0.00 19:16:41 07:13:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:13:01 PM eth0 63.71 34.64 103.32 10.86 0.00 0.00 0.00 0.00 19:16:41 07:14:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:14:01 PM eth0 56.32 32.74 94.55 10.12 0.00 0.00 0.00 0.00 19:16:41 07:15:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:15:01 PM eth0 57.52 34.73 93.32 14.71 0.00 0.00 0.00 0.00 19:16:41 07:16:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 07:16:01 PM eth0 12.13 11.53 8.67 5.75 0.00 0.00 0.00 0.00 19:16:41 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:16:41 Average: eth0 439.01 333.70 8925.49 27.12 0.00 0.00 0.00 0.00 19:16:41 19:16:41 19:16:41 ---> sar -P ALL: 19:16:41 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 11/08/2026 _x86_64_ (2 CPU) 19:16:41 19:16:41 19:03:47 LINUX RESTART (2 CPU) 19:16:41 19:16:41 07:05:01 PM CPU %user %nice %system %iowait %steal %idle 19:16:41 07:06:01 PM all 24.52 0.00 3.20 1.35 0.08 70.85 19:16:41 07:06:01 PM 0 28.63 0.00 3.70 2.00 0.10 65.57 19:16:41 07:06:01 PM 1 20.39 0.00 2.70 0.70 0.07 76.13 19:16:41 07:07:01 PM all 24.20 0.00 3.30 1.94 0.08 70.48 19:16:41 07:07:01 PM 0 32.00 0.00 3.47 1.38 0.08 63.06 19:16:41 07:07:01 PM 1 16.39 0.00 3.12 2.49 0.08 77.92 19:16:41 07:08:01 PM all 30.11 0.00 3.00 1.29 0.08 65.52 19:16:41 07:08:01 PM 0 44.68 0.00 3.04 1.43 0.08 50.77 19:16:41 07:08:01 PM 1 15.53 0.00 2.97 1.15 0.07 80.28 19:16:41 07:09:01 PM all 22.37 0.00 3.55 1.42 0.08 72.58 19:16:41 07:09:01 PM 0 31.35 0.00 3.56 1.59 0.08 63.42 19:16:41 07:09:01 PM 1 13.39 0.00 3.55 1.25 0.07 81.74 19:16:41 07:10:01 PM all 23.68 0.00 11.86 2.97 0.11 61.38 19:16:41 07:10:01 PM 0 34.33 0.00 15.98 3.42 0.12 46.15 19:16:41 07:10:01 PM 1 13.20 0.00 7.81 2.53 0.10 76.36 19:16:41 07:11:01 PM all 21.08 0.00 12.65 3.41 0.10 62.76 19:16:41 07:11:01 PM 0 25.16 0.00 15.02 4.03 0.10 55.68 19:16:41 07:11:01 PM 1 17.06 0.00 10.31 2.80 0.10 69.72 19:16:41 07:12:01 PM all 21.01 0.00 2.72 0.73 0.08 75.47 19:16:41 07:12:01 PM 0 38.46 0.00 3.22 1.00 0.08 57.23 19:16:41 07:12:01 PM 1 3.49 0.00 2.21 0.45 0.07 93.78 19:16:41 07:13:01 PM all 33.10 0.00 1.48 0.41 0.11 64.90 19:16:41 07:13:01 PM 0 57.47 0.00 2.17 0.70 0.13 39.53 19:16:41 07:13:01 PM 1 8.59 0.00 0.79 0.12 0.08 90.42 19:16:41 07:14:01 PM all 34.76 0.00 1.33 0.47 0.10 63.35 19:16:41 07:14:01 PM 0 55.93 0.00 1.84 0.83 0.12 41.28 19:16:41 07:14:01 PM 1 13.48 0.00 0.82 0.10 0.08 85.51 19:16:41 07:15:01 PM all 35.02 0.00 1.50 0.49 0.11 62.87 19:16:41 07:15:01 PM 0 58.40 0.00 2.03 0.77 0.13 38.67 19:16:41 07:15:01 PM 1 11.52 0.00 0.97 0.22 0.08 87.21 19:16:41 07:16:01 PM all 23.16 0.00 2.61 6.19 0.08 67.96 19:16:41 07:16:01 PM 0 36.06 0.00 2.99 5.20 0.08 55.67 19:16:41 07:16:01 PM 1 10.26 0.00 2.22 7.19 0.07 80.26 19:16:41 19:16:41 Average: CPU %user %nice %system %iowait %steal %idle 19:16:41 Average: all 26.64 0.00 4.27 1.88 0.09 67.11 19:16:41 Average: 0 40.27 0.00 5.14 2.03 0.10 52.46 19:16:41 Average: 1 13.03 0.00 3.41 1.73 0.08 81.75 19:16:41 19:16:41 19:16:41