05:04:30  Started by timer
05:04:30  Running as SYSTEM
05:04:30  [EnvInject] - Loading node environment variables.
05:04:31  Building remotely on prd-centos8-builder-2c-4g-2100 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
05:04:31  [ssh-agent] Looking for ssh-agent implementation...
05:04:31  $ ssh-agent
05:04:31  SSH_AUTH_SOCK=/tmp/ssh-epetKDpNW9ld/agent.5173
05:04:31  SSH_AGENT_PID=5175
05:04:31  [ssh-agent] Started.
05:04:31  Running ssh-add (command line suppressed)
05:04:31  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_10326707503851123627.key (jenkins-ssh)
05:04:31  [ssh-agent] Using credentials jenkins (jenkins)
05:04:31  The recommended git tool is: NONE
05:04:33  using credential jenkins
05:04:33  Wiping out workspace first.
05:04:33  Cloning the remote Git repository
05:04:33  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
05:04:33   > git init /w/workspace/ci-management-openstack-cron # timeout=10
05:04:33  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
05:04:33   > git --version # timeout=10
05:04:33   > git --version # 'git version 2.43.0'
05:04:33  using GIT_SSH to set credentials jenkins
05:04:33  [INFO] Currently running in a labeled security context
05:04:33  [INFO] Currently SELinux is 'enforcing' on the host
05:04:33   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh9256651930134845009.key
05:04:33   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
05:04:37   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
05:04:37   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
05:04:37  Avoid second fetch
05:04:37   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
05:04:37  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
05:04:37   > git config core.sparsecheckout # timeout=10
05:04:37   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
05:04:38  Commit message: "CI: Update github2gerrit caller to v2.4.4"
05:04:38   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
05:04:38   > git remote # timeout=10
05:04:38   > git submodule init # timeout=10
05:04:38   > git submodule sync # timeout=10
05:04:38   > git config --get remote.origin.url # timeout=10
05:04:38   > git submodule init # timeout=10
05:04:38   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
05:04:38   > git config --get submodule.packer/common-packer.url # timeout=10
05:04:38   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
05:04:38   > git config --get submodule.global-jjb.url # timeout=10
05:04:38   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
05:04:38   > git submodule update --init --recursive packer/common-packer # timeout=10
05:04:42   > git submodule update --init --recursive global-jjb # timeout=10
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
05:04:53  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
05:04:53  provisioning config files...
05:04:53  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
05:04:53  copy managed file [npmrc] to file:/home/jenkins/.npmrc
05:04:53  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
05:04:53  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins16861656726053190087.sh
05:04:53  ---> python-tools-install.sh
05:04:53  Setup pyenv:
05:04:53    system
05:04:53  * 3.8.13 (set by /opt/pyenv/version)
05:04:53  * 3.9.13 (set by /opt/pyenv/version)
05:04:53  * 3.10.6 (set by /opt/pyenv/version)
05:04:58  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-lcsu
05:04:58  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
05:04:58  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:05:10  lf-activate-venv(): INFO: Installing additional packages: lftools 
05:05:45  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:05:45  Generating Requirements File
05:06:28  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
05:06:28  botocore 1.43.125 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
05:06:28  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
05:06:28  Python 3.10.6
05:06:28  pip 26.3 from /tmp/venv-lcsu/lib/python3.10/site-packages/pip (python 3.10)
05:06:29  aiohappyeyeballs==2.7.1
05:06:29  aiohttp==3.14.5
05:06:29  aiosignal==1.4.0
05:06:29  appdirs==1.4.4
05:06:29  argcomplete==3.7.2
05:06:29  aspy.yaml==1.3.0
05:06:29  async-timeout==5.0.1
05:06:29  attrs==26.1.0
05:06:29  autopage==0.6.0
05:06:29  backports.strenum==1.3.1
05:06:29  beautifulsoup4==4.15.0
05:06:29  boto3==1.43.125
05:06:29  botocore==1.43.125
05:06:29  bs4==0.0.2
05:06:29  certifi==2026.10.23
05:06:29  cffi==2.1.1
05:06:29  cfgv==3.5.0
05:06:29  chardet==7.7.0
05:06:29  charset-normalizer==3.5.2
05:06:29  click==8.5.1
05:06:29  cliff==4.14.0
05:06:29  cmd2==3.5.1
05:06:29  cryptography==3.3.2
05:06:29  debtcollector==3.1.0
05:06:29  decorator==5.3.1
05:06:29  defusedxml==0.7.1
05:06:29  Deprecated==1.3.1
05:06:29  distlib==0.4.4
05:06:29  dnspython==2.8.0
05:06:29  docker==7.2.0
05:06:29  dogpile.cache==1.5.0
05:06:29  durationpy==0.11
05:06:29  email-validator==2.3.0
05:06:29  filelock==4.1.0
05:06:29  frozenlist==1.8.0
05:06:29  future==1.0.0
05:06:29  gitdb==4.0.12
05:06:29  GitPython==3.2.1
05:06:29  httplib2==0.30.2
05:06:29  identify==2.6.20
05:06:29  idna==3.20
05:06:29  importlib-resources==1.5.0
05:06:29  iso8601==2.1.0
05:06:29  Jinja2==3.1.6
05:06:29  jmespath==1.1.0
05:06:29  jsonpatch==1.44
05:06:29  jsonpointer==3.10
05:06:29  jsonschema==4.26.0
05:06:29  jsonschema-specifications==2025.9.1
05:06:29  keystoneauth1==5.14.0
05:06:29  kubernetes==36.0.3
05:06:29  lftools==0.37.26
05:06:29  lxml==6.1.3
05:06:29  markdown-it-py==4.2.0
05:06:29  MarkupSafe==3.0.4
05:06:29  mdurl==0.1.2
05:06:29  msgpack==1.2.4
05:06:29  multi_key_dict==2.0.4
05:06:29  multidict==7.1.0
05:06:29  munch==4.0.0
05:06:29  netaddr==1.3.0
05:06:29  niet==1.4.2
05:06:29  nodeenv==1.12.0
05:06:29  oauth2client==4.1.3
05:06:29  oauthlib==4.0.1
05:06:29  openstacksdk==4.13.0
05:06:29  os-service-types==1.8.2
05:06:29  osc-lib==4.6.0
05:06:29  oslo.config==10.4.0
05:06:29  oslo.context==6.4.0
05:06:29  oslo.i18n==6.8.0
05:06:29  oslo.log==8.2.0
05:06:29  oslo.serialization==5.10.0
05:06:29  oslo.utils==10.1.1
05:06:29  packaging==26.3
05:06:29  pbr==7.1.3
05:06:29  platformdirs==4.12.4
05:06:29  prettytable==3.18.0
05:06:29  propcache==0.5.4
05:06:29  psutil==7.2.2
05:06:29  pyasn1==0.6.5
05:06:29  pyasn1_modules==0.4.2
05:06:29  pycparser==3.11
05:06:29  pygerrit2==2.0.15
05:06:29  PyGithub==2.10.0
05:06:29  Pygments==2.21.0
05:06:29  PyJWT==2.15.1
05:06:29  PyNaCl==1.6.2
05:06:29  pyparsing==2.4.7
05:06:29  pyperclip==1.11.0
05:06:29  pyrsistent==0.20.0
05:06:29  python-cinderclient==9.9.0
05:06:29  python-dateutil==3.0.0
05:06:29  python-discovery==1.9.4
05:06:29  python-heatclient==5.2.0
05:06:29  python-jenkins==1.8.3
05:06:29  python-keystoneclient==6.0.0
05:06:29  python-magnumclient==4.11.0
05:06:29  python-openstackclient==10.0.0
05:06:29  python-swiftclient==4.11.0
05:06:29  PyYAML==6.0.3
05:06:29  referencing==0.37.0
05:06:29  requests==2.34.2
05:06:29  requests-oauthlib==2.0.0
05:06:29  rfc3986==2.0.0
05:06:29  rich==15.0.0
05:06:29  rich-argparse==1.8.0
05:06:29  rpds-py==0.30.0
05:06:29  rsa==4.9.1
05:06:29  ruamel.yaml==0.19.1
05:06:29  ruamel.yaml.clib==0.2.15
05:06:29  s3transfer==0.19.3
05:06:29  simplejson==4.2.0
05:06:29  six==1.17.0
05:06:29  smmap==5.0.3
05:06:29  soupsieve==2.10
05:06:29  stevedore==5.8.0
05:06:29  tabulate==0.10.0
05:06:29  toml==0.10.2
05:06:29  tomlkit==0.15.2
05:06:29  tqdm==4.70.1
05:06:29  typing_extensions==4.16.0
05:06:29  tzdata==2026.6
05:06:29  urllib3==1.26.20
05:06:29  virtualenv==21.15.6
05:06:29  wcwidth==0.9.4
05:06:29  websocket-client==1.9.2
05:06:29  wrapt==2.5.2
05:06:29  xdg==6.0.0
05:06:29  xmltodict==1.0.4
05:06:29  yarl==1.25.1
05:06:29  yq==4.4.5
05:06:29  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins4036002274425074738.sh
05:06:29  ---> uv-install.sh
05:06:29  Installing uv/uvx (latest) using shell installer
05:06:35  2026-11-07 05:06:35 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-ZAypVy.sh" [1]
05:06:35  downloading uv 0.13.7 x86_64-unknown-linux-gnu
05:06:40  installing to /home/jenkins/.local/bin
05:06:40    uv
05:06:40    uvx
05:06:40  everything's installed!
05:06:40  ---> Validating uv/uvx install
05:06:40  uvx 0.13.7 (x86_64-unknown-linux-gnu)
05:06:40  [EnvInject] - Injecting environment variables from a build step.
05:06:40  [EnvInject] - Injecting as environment variables the properties content 
05:06:40  OS_CLOUD=vex
05:06:40  
05:06:40  [EnvInject] - Variables injected successfully.
05:06:40  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
05:06:40  Run condition [Boolean condition] enabling perform for step [Execute shell]
05:06:40  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9267596782852907388.sh
05:06:40  ---> Orphaned k8s clusters
05:06:40  Setup pyenv:
05:06:40    system
05:06:40    3.8.13
05:06:40    3.9.13
05:06:40  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:06:40  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:06:40  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:06:45  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
05:07:12  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
05:07:12  botocore 1.43.125 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
05:07:13  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:07:24  -----> Delete orphaned cluster
05:07:24  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
05:07:24  Run condition [Boolean condition] enabling perform for step [Execute shell]
05:07:24  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins17628239015709085184.sh
05:07:24  ---> Orphaned stacks
05:07:24  Setup pyenv:
05:07:24    system
05:07:24    3.8.13
05:07:24    3.9.13
05:07:24  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:07:24  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:07:24  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:07:29  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
05:08:01  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:08:01  + mapfile -t OS_COE_CLUSTERS_ID
05:08:01  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
05:08:01  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
05:08:01  ++ awk '{print $1}'
05:08:11  + echo '-----> Active clusters -> stacks'
05:08:11  -----> Active clusters -> stacks
05:08:11  + OS_COE_STACKS=()
05:08:11  + [[ 0 -gt 0 ]]
05:08:11  + mapfile -t OS_STACKS
05:08:11  ++ awk '{print $1}'
05:08:11  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
05:08:20  + echo '-----> Active stacks'
05:08:20  -----> Active stacks
05:08:20  + echo '-----> Delete orphaned stacks'
05:08:20  -----> Delete orphaned stacks
05:08:20  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
05:08:20  Run condition [Boolean condition] enabling perform for step [Execute shell]
05:08:20  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins16524581278876409167.sh
05:08:20  ---> Orphaned servers
05:08:20  Setup pyenv:
05:08:20    system
05:08:20    3.8.13
05:08:20    3.9.13
05:08:20  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:08:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:08:20  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:08:25  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
05:11:07    WARNING: Connection interrupted while downloading.
05:11:07    WARNING: Attempting to resume incomplete download (7.3 MB/13.4 MB, attempt 1)
05:11:10    WARNING: Attempting to resume incomplete download (7.3 MB/13.4 MB, attempt 2)
05:11:14    WARNING: Attempting to resume incomplete download (7.3 MB/13.4 MB, attempt 3)
05:11:17    WARNING: Attempting to resume incomplete download (7.3 MB/13.4 MB, attempt 4)
05:11:20    WARNING: Attempting to resume incomplete download (7.3 MB/13.4 MB, attempt 5)
05:11:23  error: incomplete-download
05:11:23  
05:11:23  × Download failed after 6 attempts because not enough bytes were received (7.3 MB/13.4 MB)
05:11:23  ╰─> URL: https://nexus3.o-ran-sc.org/repository/PyPi/packages/botocore/1.37.16/botocore-1.37.16-py3-none-any.whl#sha256=d74d04830ead12933a96dc407175ae98b32a5dd0059d7d2b28fc7aa4ed9d3b48
05:11:23  
05:11:23  note: This is an issue with network connectivity, not pip.
05:11:23  hint: Use --resume-retries to configure resume attempt limit.
05:11:25  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
05:14:53  Build timed out (after 10 minutes). Marking the build as failed.
05:14:53  $ ssh-agent -k
05:14:53  unset SSH_AUTH_SOCK;
05:14:53  unset SSH_AGENT_PID;
05:14:53  echo Agent pid 5175 killed;
05:14:53  [ssh-agent] Stopped.
05:14:53  Build was aborted
05:14:53  [PostBuildScript] - [INFO] Executing post build scripts.
05:14:53  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins222651836400119688.sh
05:14:53  ---> sysstat.sh
05:14:53  /home/jenkins/lf-env.sh: line 73:  6644 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
05:14:53  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
05:14:53  /tmp/jenkins16524581278876409167.sh: line 67: openstack: command not found
05:14:53  -----> Active servers
05:14:53  -----> Delete orphaned servers
05:14:54  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13558338805862046488.sh
05:14:54  ---> package-listing.sh
05:14:54  ++ facter osfamily
05:14:54  ++ tr '[:upper:]' '[:lower:]'
05:14:55  + OS_FAMILY=redhat
05:14:55  + workspace=/w/workspace/ci-management-openstack-cron
05:14:55  + START_PACKAGES=/tmp/packages_start.txt
05:14:55  + END_PACKAGES=/tmp/packages_end.txt
05:14:55  + DIFF_PACKAGES=/tmp/packages_diff.txt
05:14:55  + PACKAGES=/tmp/packages_start.txt
05:14:55  + '[' /w/workspace/ci-management-openstack-cron ']'
05:14:55  + PACKAGES=/tmp/packages_end.txt
05:14:55  + case "${OS_FAMILY}" in
05:14:55  + rpm -qa
05:14:55  + sort
05:15:02  + '[' -f /tmp/packages_start.txt ']'
05:15:02  + '[' -f /tmp/packages_end.txt ']'
05:15:02  + diff /tmp/packages_start.txt /tmp/packages_end.txt
05:15:02  + '[' /w/workspace/ci-management-openstack-cron ']'
05:15:02  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
05:15:02  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
05:15:02  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12314433144760227615.sh
05:15:02  ---> capture-instance-metadata.sh
05:15:02  Setup pyenv:
05:15:02    system
05:15:02    3.8.13
05:15:02    3.9.13
05:15:02  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:15:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:15:02  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:15:07  lf-activate-venv(): INFO: Installing additional packages: lftools 
05:15:22  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:15:22  INFO: Running in OpenStack, capturing instance metadata
05:15:23  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7279572582541812724.sh
05:15:23  provisioning config files...
05:15:23  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config1152167235567571273tmp
05:15:23  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
05:15:23  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
05:15:23  [EnvInject] - Injecting environment variables from a build step.
05:15:23  [EnvInject] - Injecting as environment variables the properties content 
05:15:23  SERVER_ID=logs
05:15:23  
05:15:23  [EnvInject] - Variables injected successfully.
05:15:23  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins262188963997068702.sh
05:15:23  ---> create-netrc.sh
05:15:23  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14907792853518182380.sh
05:15:23  ---> python-tools-install.sh
05:15:23  Setup pyenv:
05:15:23    system
05:15:23    3.8.13
05:15:23    3.9.13
05:15:23  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:15:23  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:15:23  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:15:28  lf-activate-venv(): INFO: Installing additional packages: lftools 
05:15:43  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:15:43  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13322005105383316945.sh
05:15:43  ---> uv-install.sh
05:15:43  uv 0.13.7 is already installed
05:15:43  uvx 0.13.7 (x86_64-unknown-linux-gnu)
05:15:43  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins1968592437741543847.sh
05:15:43  ---> sudo-logs.sh
05:15:43  Archiving 'sudo' log..
05:15:43  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11687992307752740278.sh
05:15:43  ---> job-cost.sh
05:15:43  INFO: Activating Python virtual environment...
05:15:43  Setup pyenv:
05:15:43    system
05:15:43    3.8.13
05:15:43    3.9.13
05:15:43  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:15:44  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:15:44  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:15:49  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
05:16:00  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:16:00  INFO: No stack-cost file found
05:16:00  INFO: Instance uptime: 748s
05:16:00  INFO: Fetching instance metadata (attempt 1 of 3)...
05:16:00  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
05:16:01  INFO: Successfully fetched instance metadata
05:16:01  INFO: Instance type: v3-starter-2
05:16:01  INFO: Retrieving pricing info for: v3-starter-2
05:16:01  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
05:16:01  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=748
05:16:04  INFO: Successfully fetched Vexxhost pricing API
05:16:04  INFO: Retrieved cost: 0.02
05:16:04  INFO: Retrieved resource: v3-starter-2
05:16:04  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
05:16:04  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
05:16:04  INFO: Successfully archived job cost data
05:16:04  DEBUG: Cost data: ci-management-openstack-cron,63666,2026-11-07 05:16:04,v3-starter-2,748,0.02,0.00,FAILURE
05:16:04  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8397017223738424742.sh
05:16:04  ---> logs-deploy.sh
05:16:04  Setup pyenv:
05:16:04    system
05:16:04    3.8.13
05:16:04    3.9.13
05:16:04  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
05:16:04  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-lcsu from file:/tmp/.os_lf_venv
05:16:04  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
05:16:10  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
05:16:25  lf-activate-venv(): INFO: Adding /tmp/venv-lcsu/bin to PATH
05:16:25  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63666
05:16:25  INFO: archiving workspace using pattern(s): 
05:16:30  Archives upload complete.
05:16:31  INFO: archiving logs to Nexus
05:16:32  ---> uname -a:
05:16:32  Linux prd-centos8-builder-2c-4g-2100.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
05:16:32  
05:16:32  
05:16:32  ---> lscpu:
05:16:32  Architecture:        x86_64
05:16:32  CPU op-mode(s):      32-bit, 64-bit
05:16:32  Byte Order:          Little Endian
05:16:32  CPU(s):              2
05:16:32  On-line CPU(s) list: 0,1
05:16:32  Thread(s) per core:  1
05:16:32  Core(s) per socket:  1
05:16:32  Socket(s):           2
05:16:32  NUMA node(s):        1
05:16:32  Vendor ID:           AuthenticAMD
05:16:32  CPU family:          23
05:16:32  Model:               49
05:16:32  Model name:          AMD EPYC-Rome Processor
05:16:32  Stepping:            0
05:16:32  CPU MHz:             2799.998
05:16:32  BogoMIPS:            5599.99
05:16:32  Virtualization:      AMD-V
05:16:32  Hypervisor vendor:   KVM
05:16:32  Virtualization type: full
05:16:32  L1d cache:           32K
05:16:32  L1i cache:           32K
05:16:32  L2 cache:            512K
05:16:32  L3 cache:            16384K
05:16:32  NUMA node0 CPU(s):   0,1
05:16:32  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
05:16:32  
05:16:32  
05:16:32  ---> nproc:
05:16:32  2
05:16:32  
05:16:32  
05:16:32  ---> df -h:
05:16:32  Filesystem      Size  Used Avail Use% Mounted on
05:16:32  devtmpfs        1.8G     0  1.8G   0% /dev
05:16:32  tmpfs           1.8G     0  1.8G   0% /dev/shm
05:16:32  tmpfs           1.8G   17M  1.8G   1% /run
05:16:32  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
05:16:32  /dev/vda1        20G   15G  5.5G  73% /
05:16:32  tmpfs           367M     0  367M   0% /run/user/1001
05:16:32  
05:16:32  
05:16:32  ---> free -m:
05:16:32                total        used        free      shared  buff/cache   available
05:16:32  Mem:           3665         452        1278          17        1934        2912
05:16:32  Swap:          1023           0        1023
05:16:32  
05:16:32  
05:16:32  ---> ip addr:
05:16:32  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
05:16:32      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
05:16:32      inet 127.0.0.1/8 scope host lo
05:16:32         valid_lft forever preferred_lft forever
05:16:32      inet6 ::1/128 scope host 
05:16:32         valid_lft forever preferred_lft forever
05:16:32  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
05:16:32      link/ether fa:16:3e:a8:f9:bd brd ff:ff:ff:ff:ff:ff
05:16:32      altname enp0s3
05:16:32      altname ens3
05:16:32      inet 10.32.7.188/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
05:16:32         valid_lft 85653sec preferred_lft 85653sec
05:16:32      inet6 fe80::f816:3eff:fea8:f9bd/64 scope link 
05:16:32         valid_lft forever preferred_lft forever
05:16:32  
05:16:32  
05:16:32  ---> sar -b -r -n DEV:
05:16:32  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/07/2026 	_x86_64_	(2 CPU)
05:16:32  
05:16:32  05:03:40     LINUX RESTART	(2 CPU)
05:16:32  
05:16:32  05:05:01 AM       tps      rtps      wtps   bread/s   bwrtn/s
05:16:32  05:06:01 AM     54.00      0.47     53.53     40.92   5489.84
05:16:32  05:07:01 AM     63.45      0.73     62.71    202.07  12574.49
05:16:32  05:08:01 AM     41.11      0.52     40.59     61.46   8632.38
05:16:32  05:09:01 AM     49.93      0.40     49.53     63.57  41151.51
05:16:32  05:10:02 AM    108.15      1.13    107.01    195.37 154277.43
05:16:32  05:11:01 AM    124.94      5.18    119.76    485.53 167102.30
05:16:32  05:12:01 AM     43.00      3.47     39.54    419.73  25768.94
05:16:32  05:13:01 AM     46.96      0.45     46.51     10.53   1173.44
05:16:32  05:14:01 AM     52.21      0.03     52.17      1.07   1358.44
05:16:32  05:15:01 AM    115.48     72.74     42.74   6006.13   1141.69
05:16:32  05:16:01 AM     39.99     19.26     20.73   2133.96    640.39
05:16:32  Average:        67.11      9.50     57.62    875.18  37926.88
05:16:32  
05:16:32  05:05:01 AM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
05:16:32  05:06:01 AM   1316732   3011956   2436952     64.92      2104   1863172    612208     12.75    142352   2004180    179636
05:16:32  05:07:01 AM    992648   2904808   2761036     73.56      2104   2071440    680324     14.17    140236   2291048     57976
05:16:32  05:08:01 AM   1023008   2984556   2730676     72.75      2104   2119036    607064     12.64    159320   2238784     97572
05:16:32  05:09:01 AM    143944   2863728   3609740     96.17      2104   2877988    728140     15.16    195372   3080964    140116
05:16:32  05:10:02 AM    147080   2835688   3606604     96.08      2104   2841212    777784     16.20    244620   3044716    172704
05:16:32  05:11:01 AM    121196   2803736   3632488     96.77      2104   2828620    831028     17.30    296816   3038388    200224
05:16:32  05:12:01 AM   1579280   2929600   2174404     57.93      2104   1499600    712340     14.83    185252   1697844       956
05:16:32  05:13:01 AM   1556772   2920004   2196912     58.53      2104   1510216    712340     14.83    189608   1708492      2280
05:16:32  05:14:01 AM   1519948   2893216   2233736     59.51      2104   1521680    734928     15.30    194156   1733688      2496
05:16:32  05:15:01 AM   1473832   3033196   2279852     60.74      2104   1709172    591272     12.31    206052   1758584      1840
05:16:32  05:16:01 AM   1408756   3049880   2344928     62.47      2104   1789980    557180     11.60    212536   1809744     19712
05:16:32  Average:      1025745   2930033   2727939     72.67      2104   2057465    685873     14.28    196938   2218767     79592
05:16:32  
05:16:32  05:05:01 AM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
05:16:32  05:06:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:06:01 AM      eth0     48.65     43.70    985.24      5.27      0.00      0.00      0.00      0.00
05:16:32  05:07:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:07:01 AM      eth0     60.16     50.80    940.84      7.00      0.00      0.00      0.00      0.00
05:16:32  05:08:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:08:01 AM      eth0     40.48     37.21    724.61      5.21      0.00      0.00      0.00      0.00
05:16:32  05:09:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:09:01 AM      eth0    509.55    392.20  10056.71     29.22      0.00      0.00      0.00      0.00
05:16:32  05:10:02 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:10:02 AM      eth0   2023.22   1487.71  38867.85    100.37      0.00      0.00      0.00      0.00
05:16:32  05:11:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:11:01 AM      eth0   2168.23   1593.14  42199.64    107.99      0.00      0.00      0.00      0.00
05:16:32  05:12:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:12:01 AM      eth0    300.03    201.05   4827.27     16.43      0.00      0.00      0.00      0.00
05:16:32  05:13:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:13:01 AM      eth0     55.56     33.99     66.15     10.87      0.00      0.00      0.00      0.00
05:16:32  05:14:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:14:01 AM      eth0     61.81     37.71     72.97      8.48      0.00      0.00      0.00      0.00
05:16:32  05:15:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:15:01 AM      eth0     50.50     30.32     59.19      7.76      0.00      0.00      0.00      0.00
05:16:32  05:16:01 AM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  05:16:01 AM      eth0     12.71     12.88      8.67      6.31      0.00      0.00      0.00      0.00
05:16:32  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
05:16:32  Average:         eth0    482.12    354.59   8933.12     27.60      0.00      0.00      0.00      0.00
05:16:32  
05:16:32  
05:16:32  ---> sar -P ALL:
05:16:32  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/07/2026 	_x86_64_	(2 CPU)
05:16:32  
05:16:32  05:03:40     LINUX RESTART	(2 CPU)
05:16:32  
05:16:32  05:05:01 AM     CPU     %user     %nice   %system   %iowait    %steal     %idle
05:16:32  05:06:01 AM     all     23.93      0.00      3.28      1.27      0.09     71.43
05:16:32  05:06:01 AM       0     37.99      0.00      4.49      1.23      0.10     56.19
05:16:32  05:06:01 AM       1      9.87      0.00      2.07      1.30      0.08     86.68
05:16:32  05:07:01 AM     all     25.66      0.00      3.06      2.21      0.09     68.97
05:16:32  05:07:01 AM       0     35.90      0.00      3.44      2.22      0.10     58.34
05:16:32  05:07:01 AM       1     15.42      0.00      2.69      2.21      0.08     79.60
05:16:32  05:08:01 AM     all     29.20      0.00      3.50      1.49      0.10     65.71
05:16:32  05:08:01 AM       0     45.85      0.00      4.95      1.62      0.10     47.47
05:16:32  05:08:01 AM       1     12.57      0.00      2.05      1.37      0.10     83.92
05:16:32  05:09:01 AM     all     20.28      0.00      3.87      1.73      0.08     74.05
05:16:32  05:09:01 AM       0     32.41      0.00      4.34      1.61      0.08     61.56
05:16:32  05:09:01 AM       1      8.18      0.00      3.40      1.84      0.07     86.51
05:16:32  05:10:02 AM     all     23.48      0.00     11.55      2.77      0.12     62.08
05:16:32  05:10:02 AM       0     35.88      0.00     16.65      3.09      0.14     44.25
05:16:32  05:10:02 AM       1     11.25      0.00      6.53      2.45      0.10     79.67
05:16:32  05:11:01 AM     all     20.67      0.00     12.73      3.22      0.11     63.28
05:16:32  05:11:01 AM       0     29.96      0.00     17.29      3.37      0.12     49.26
05:16:32  05:11:01 AM       1     11.50      0.00      8.23      3.07      0.10     77.10
05:16:32  05:12:01 AM     all     15.93      0.00      2.56      0.69      0.07     80.75
05:16:32  05:12:01 AM       0     25.71      0.00      3.38      0.77      0.08     70.06
05:16:32  05:12:01 AM       1      6.14      0.00      1.74      0.62      0.05     91.45
05:16:32  05:13:01 AM     all     25.67      0.00      1.03      0.32      0.08     72.90
05:16:32  05:13:01 AM       0     47.16      0.00      1.57      0.62      0.10     50.55
05:16:32  05:13:01 AM       1      4.07      0.00      0.49      0.02      0.07     95.36
05:16:32  05:14:01 AM     all     22.89      0.00      1.21      0.23      0.10     75.56
05:16:32  05:14:01 AM       0     38.23      0.00      1.59      0.40      0.12     59.67
05:16:32  05:14:01 AM       1      7.52      0.00      0.84      0.07      0.08     91.49
05:16:32  05:15:01 AM     all     23.98      0.00      1.58      5.07      0.09     69.28
05:16:32  05:15:01 AM       0     36.20      0.00      1.92      9.00      0.10     52.77
05:16:32  05:15:01 AM       1     11.74      0.00      1.24      1.12      0.08     85.82
05:16:32  05:16:01 AM     all     27.15      0.00      2.57      1.59      0.09     68.60
05:16:32  05:16:01 AM       0     31.78      0.00      2.90      2.42      0.10     62.80
05:16:32  05:16:01 AM       1     22.51      0.00      2.24      0.75      0.08     74.42
05:16:32  
05:16:32  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
05:16:32  Average:        all     23.54      0.00      4.24      1.87      0.09     70.26
05:16:32  Average:          0     36.12      0.00      5.63      2.39      0.10     55.75
05:16:32  Average:          1     10.98      0.00      2.85      1.34      0.08     84.74
05:16:32  
05:16:32  
05:16:32