16:04:38  Started by timer
16:04:38  Running as SYSTEM
16:04:38  [EnvInject] - Loading node environment variables.
16:04:39  Building remotely on prd-centos8-builder-2c-4g-2313 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
16:04:39  [ssh-agent] Looking for ssh-agent implementation...
16:04:39  $ ssh-agent
16:04:39  SSH_AUTH_SOCK=/tmp/ssh-BTs8C4zp1zMv/agent.5167
16:04:39  SSH_AGENT_PID=5169
16:04:39  [ssh-agent] Started.
16:04:39  Running ssh-add (command line suppressed)
16:04:39  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_13174281964436326130.key (jenkins-ssh)
16:04:39  [ssh-agent] Using credentials jenkins (jenkins)
16:04:39  The recommended git tool is: NONE
16:04:41  using credential jenkins
16:04:41  Wiping out workspace first.
16:04:41  Cloning the remote Git repository
16:04:41  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:04:41   > git init /w/workspace/ci-management-openstack-cron # timeout=10
16:04:41  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:04:41   > git --version # timeout=10
16:04:41   > git --version # 'git version 2.43.0'
16:04:41  using GIT_SSH to set credentials jenkins
16:04:41  [INFO] Currently running in a labeled security context
16:04:41  [INFO] Currently SELinux is 'enforcing' on the host
16:04:41   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh542875208601217642.key
16:04:41   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
16:04:45   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:04:45   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
16:04:45  Avoid second fetch
16:04:45   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
16:04:45  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
16:04:45   > git config core.sparsecheckout # timeout=10
16:04:45   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
16:04:46  Commit message: "CI: Update github2gerrit caller to v2.4.4"
16:04:46   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
16:04:46   > git remote # timeout=10
16:04:46   > git submodule init # timeout=10
16:04:46   > git submodule sync # timeout=10
16:04:46   > git config --get remote.origin.url # timeout=10
16:04:46   > git submodule init # timeout=10
16:04:46   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
16:04:46   > git config --get submodule.packer/common-packer.url # timeout=10
16:04:46   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
16:04:46   > git config --get submodule.global-jjb.url # timeout=10
16:04:46   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
16:04:46   > git submodule update --init --recursive packer/common-packer # timeout=10
16:04:50   > git submodule update --init --recursive global-jjb # timeout=10
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
16:05:01  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
16:05:01  provisioning config files...
16:05:01  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
16:05:01  copy managed file [npmrc] to file:/home/jenkins/.npmrc
16:05:01  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
16:05:01  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3353833298071821855.sh
16:05:01  ---> python-tools-install.sh
16:05:01  Setup pyenv:
16:05:01    system
16:05:01  * 3.8.13 (set by /opt/pyenv/version)
16:05:01  * 3.9.13 (set by /opt/pyenv/version)
16:05:01  * 3.10.6 (set by /opt/pyenv/version)
16:05:06  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-yNDH
16:05:06  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
16:05:06  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:05:18  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:05:53  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:05:53  Generating Requirements File
16:06:36  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
16:06:36  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
16:06:36  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
16:06:37  Python 3.10.6
16:06:37  pip 26.3 from /tmp/venv-yNDH/lib/python3.10/site-packages/pip (python 3.10)
16:06:37  aiohappyeyeballs==2.7.1
16:06:37  aiohttp==3.14.5
16:06:37  aiosignal==1.4.0
16:06:37  appdirs==1.4.4
16:06:37  argcomplete==3.7.2
16:06:37  aspy.yaml==1.3.0
16:06:37  async-timeout==5.0.1
16:06:37  attrs==26.1.0
16:06:37  autopage==0.6.0
16:06:37  backports.strenum==1.3.1
16:06:37  beautifulsoup4==4.15.0
16:06:37  boto3==1.43.126
16:06:37  botocore==1.43.126
16:06:37  bs4==0.0.2
16:06:37  certifi==2026.10.23
16:06:37  cffi==2.1.1
16:06:37  cfgv==3.5.0
16:06:37  chardet==7.7.0
16:06:37  charset-normalizer==3.5.2
16:06:37  click==8.5.1
16:06:37  cliff==4.14.0
16:06:37  cmd2==3.5.1
16:06:37  cryptography==3.3.2
16:06:37  debtcollector==3.1.0
16:06:37  decorator==5.3.1
16:06:37  defusedxml==0.7.1
16:06:37  Deprecated==1.3.1
16:06:37  distlib==0.4.4
16:06:37  dnspython==2.8.0
16:06:37  docker==7.2.0
16:06:37  dogpile.cache==1.5.0
16:06:37  durationpy==0.11
16:06:37  email-validator==2.3.0
16:06:37  filelock==4.1.0
16:06:37  frozenlist==1.8.0
16:06:37  future==1.0.0
16:06:37  gitdb==4.0.12
16:06:37  GitPython==3.2.1
16:06:37  httplib2==0.30.2
16:06:37  identify==2.6.20
16:06:37  idna==3.20
16:06:37  importlib-resources==1.5.0
16:06:37  iso8601==2.1.0
16:06:37  Jinja2==3.1.6
16:06:37  jmespath==1.1.0
16:06:37  jsonpatch==1.44
16:06:37  jsonpointer==3.10
16:06:37  jsonschema==4.26.0
16:06:37  jsonschema-specifications==2025.9.1
16:06:37  keystoneauth1==5.14.0
16:06:37  kubernetes==36.0.3
16:06:37  lftools==0.37.26
16:06:37  lxml==6.1.3
16:06:37  markdown-it-py==4.2.0
16:06:37  MarkupSafe==3.0.4
16:06:37  mdurl==0.1.2
16:06:37  msgpack==1.2.4
16:06:37  multi_key_dict==2.0.4
16:06:37  multidict==7.1.0
16:06:37  munch==4.0.0
16:06:37  netaddr==1.3.0
16:06:37  niet==1.4.2
16:06:37  nodeenv==1.12.0
16:06:37  oauth2client==4.1.3
16:06:37  oauthlib==4.0.1
16:06:37  openstacksdk==4.13.0
16:06:37  os-service-types==1.8.2
16:06:37  osc-lib==4.6.0
16:06:37  oslo.config==10.4.0
16:06:37  oslo.context==6.4.0
16:06:37  oslo.i18n==6.8.0
16:06:37  oslo.log==8.2.0
16:06:37  oslo.serialization==5.10.0
16:06:37  oslo.utils==10.1.1
16:06:37  packaging==26.3
16:06:37  pbr==7.1.3
16:06:37  platformdirs==4.12.4
16:06:37  prettytable==3.18.0
16:06:37  propcache==0.5.4
16:06:37  psutil==7.2.2
16:06:37  pyasn1==0.6.5
16:06:37  pyasn1_modules==0.4.2
16:06:37  pycparser==3.11
16:06:37  pygerrit2==2.0.15
16:06:37  PyGithub==2.10.0
16:06:37  Pygments==2.21.0
16:06:37  PyJWT==2.15.1
16:06:37  PyNaCl==1.6.2
16:06:37  pyparsing==2.4.7
16:06:37  pyperclip==1.11.0
16:06:37  pyrsistent==0.20.0
16:06:37  python-cinderclient==9.9.0
16:06:37  python-dateutil==3.0.0
16:06:37  python-discovery==1.9.5
16:06:37  python-heatclient==5.2.0
16:06:37  python-jenkins==1.8.3
16:06:37  python-keystoneclient==6.0.0
16:06:37  python-magnumclient==4.11.0
16:06:37  python-openstackclient==10.0.0
16:06:37  python-swiftclient==4.11.0
16:06:37  PyYAML==6.0.3
16:06:37  referencing==0.37.0
16:06:37  requests==2.34.2
16:06:37  requests-oauthlib==2.0.0
16:06:37  rfc3986==2.0.0
16:06:37  rich==15.0.0
16:06:37  rich-argparse==1.8.0
16:06:37  rpds-py==0.30.0
16:06:37  rsa==4.9.1
16:06:37  ruamel.yaml==0.19.1
16:06:37  ruamel.yaml.clib==0.2.15
16:06:37  s3transfer==0.19.3
16:06:37  simplejson==4.2.0
16:06:37  six==1.17.0
16:06:37  smmap==5.0.3
16:06:37  soupsieve==2.10
16:06:37  stevedore==5.8.0
16:06:37  tabulate==0.10.0
16:06:37  toml==0.10.2
16:06:37  tomlkit==0.15.2
16:06:37  tqdm==4.70.1
16:06:37  typing_extensions==4.16.0
16:06:37  tzdata==2026.6
16:06:37  urllib3==1.26.20
16:06:37  virtualenv==21.15.6
16:06:37  wcwidth==0.9.4
16:06:37  websocket-client==1.9.2
16:06:37  wrapt==2.5.2
16:06:37  xdg==6.0.0
16:06:37  xmltodict==1.0.4
16:06:37  yarl==1.25.1
16:06:37  yq==4.4.5
16:06:37  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13285225713901114566.sh
16:06:37  ---> uv-install.sh
16:06:37  Installing uv/uvx (latest) using shell installer
16:06:44  2026-11-09 16:06:44 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-HJx0Cf.sh" [1]
16:06:44  downloading uv 0.13.7 x86_64-unknown-linux-gnu
16:06:48  installing to /home/jenkins/.local/bin
16:06:48    uv
16:06:48    uvx
16:06:48  everything's installed!
16:06:48  ---> Validating uv/uvx install
16:06:48  uvx 0.13.7 (x86_64-unknown-linux-gnu)
16:06:48  [EnvInject] - Injecting environment variables from a build step.
16:06:48  [EnvInject] - Injecting as environment variables the properties content 
16:06:48  OS_CLOUD=vex
16:06:48  
16:06:48  [EnvInject] - Variables injected successfully.
16:06:48  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:06:48  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:06:48  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins14686690066660408441.sh
16:06:48  ---> Orphaned k8s clusters
16:06:48  Setup pyenv:
16:06:48    system
16:06:48    3.8.13
16:06:48    3.9.13
16:06:48  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:06:48  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:06:48  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:06:53  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
16:07:19  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
16:07:19  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
16:07:20  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:07:31  -----> Delete orphaned cluster
16:07:31  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:07:31  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:07:31  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins9865796962165318860.sh
16:07:31  ---> Orphaned stacks
16:07:31  Setup pyenv:
16:07:31    system
16:07:31    3.8.13
16:07:31    3.9.13
16:07:31  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:07:31  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:07:31  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:07:36  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
16:08:06  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:08:06  + mapfile -t OS_COE_CLUSTERS_ID
16:08:06  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
16:08:06  ++ awk '{print $1}'
16:08:06  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
16:08:16  + echo '-----> Active clusters -> stacks'
16:08:16  -----> Active clusters -> stacks
16:08:16  + OS_COE_STACKS=()
16:08:16  + [[ 0 -gt 0 ]]
16:08:16  + mapfile -t OS_STACKS
16:08:16  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
16:08:16  ++ awk '{print $1}'
16:08:25  + echo '-----> Active stacks'
16:08:25  -----> Active stacks
16:08:25  + echo '-----> Delete orphaned stacks'
16:08:25  -----> Delete orphaned stacks
16:08:25  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
16:08:25  Run condition [Boolean condition] enabling perform for step [Execute shell]
16:08:25  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins1791722424214699549.sh
16:08:25  ---> Orphaned servers
16:08:25  Setup pyenv:
16:08:25    system
16:08:25    3.8.13
16:08:25    3.9.13
16:08:25  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:08:25  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:08:25  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:08:30  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
16:11:11  ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device
16:11:11  
16:11:13  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
16:15:01  Build timed out (after 10 minutes). Marking the build as failed.
16:15:01  $ ssh-agent -k
16:15:01  unset SSH_AUTH_SOCK;
16:15:01  unset SSH_AGENT_PID;
16:15:01  echo Agent pid 5169 killed;
16:15:01  [ssh-agent] Stopped.
16:15:01  Build was aborted
16:15:01  [PostBuildScript] - [INFO] Executing post build scripts.
16:15:01  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3849358653038482266.sh
16:15:01  ---> sysstat.sh
16:15:01  /home/jenkins/lf-env.sh: line 73:  6652 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
16:15:01  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
16:15:01  /tmp/jenkins1791722424214699549.sh: line 67: openstack: command not found
16:15:01  -----> Active servers
16:15:01  -----> Delete orphaned servers
16:15:03  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10776007086730348400.sh
16:15:03  ---> package-listing.sh
16:15:03  ++ facter osfamily
16:15:03  ++ tr '[:upper:]' '[:lower:]'
16:15:04  + OS_FAMILY=redhat
16:15:04  + workspace=/w/workspace/ci-management-openstack-cron
16:15:04  + START_PACKAGES=/tmp/packages_start.txt
16:15:04  + END_PACKAGES=/tmp/packages_end.txt
16:15:04  + DIFF_PACKAGES=/tmp/packages_diff.txt
16:15:04  + PACKAGES=/tmp/packages_start.txt
16:15:04  + '[' /w/workspace/ci-management-openstack-cron ']'
16:15:04  + PACKAGES=/tmp/packages_end.txt
16:15:04  + case "${OS_FAMILY}" in
16:15:04  + rpm -qa
16:15:04  + sort
16:15:11  + '[' -f /tmp/packages_start.txt ']'
16:15:11  + '[' -f /tmp/packages_end.txt ']'
16:15:11  + diff /tmp/packages_start.txt /tmp/packages_end.txt
16:15:11  + '[' /w/workspace/ci-management-openstack-cron ']'
16:15:11  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
16:15:11  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
16:15:11  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12357762227466532882.sh
16:15:11  ---> capture-instance-metadata.sh
16:15:11  Setup pyenv:
16:15:11    system
16:15:11    3.8.13
16:15:11    3.9.13
16:15:11  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:15:11  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:15:11  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:15:13  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:15:28  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:15:28  INFO: Running in OpenStack, capturing instance metadata
16:15:28  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins10425306262657191263.sh
16:15:28  provisioning config files...
16:15:28  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config13848973048463636079tmp
16:15:28  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
16:15:28  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
16:15:28  [EnvInject] - Injecting environment variables from a build step.
16:15:28  [EnvInject] - Injecting as environment variables the properties content 
16:15:28  SERVER_ID=logs
16:15:28  
16:15:28  [EnvInject] - Variables injected successfully.
16:15:28  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7002366700342317802.sh
16:15:28  ---> create-netrc.sh
16:15:28  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins13598487309374404865.sh
16:15:28  ---> python-tools-install.sh
16:15:28  Setup pyenv:
16:15:28    system
16:15:28    3.8.13
16:15:28    3.9.13
16:15:28  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:15:29  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:15:29  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:15:33  lf-activate-venv(): INFO: Installing additional packages: lftools 
16:15:46  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:15:46  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins13767780708180203133.sh
16:15:46  ---> uv-install.sh
16:15:46  uv 0.13.7 is already installed
16:15:46  uvx 0.13.7 (x86_64-unknown-linux-gnu)
16:15:46  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2787731175058060283.sh
16:15:46  ---> sudo-logs.sh
16:15:46  Archiving 'sudo' log..
16:15:46  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18202386154265904286.sh
16:15:46  ---> job-cost.sh
16:15:46  INFO: Activating Python virtual environment...
16:15:46  Setup pyenv:
16:15:46    system
16:15:46    3.8.13
16:15:46    3.9.13
16:15:46  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:15:46  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:15:46  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:15:52  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
16:16:01  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:16:01  INFO: No stack-cost file found
16:16:01  INFO: Instance uptime: 742s
16:16:01  INFO: Fetching instance metadata (attempt 1 of 3)...
16:16:01  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
16:16:02  INFO: Successfully fetched instance metadata
16:16:02  INFO: Instance type: v3-starter-2
16:16:02  INFO: Retrieving pricing info for: v3-starter-2
16:16:02  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
16:16:02  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=742
16:16:03  INFO: Successfully fetched Vexxhost pricing API
16:16:03  INFO: Retrieved cost: 0.02
16:16:03  INFO: Retrieved resource: v3-starter-2
16:16:03  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
16:16:03  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
16:16:03  INFO: Successfully archived job cost data
16:16:03  DEBUG: Cost data: ci-management-openstack-cron,63725,2026-11-09 16:16:03,v3-starter-2,742,0.02,0.00,FAILURE
16:16:03  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins12897980768662035617.sh
16:16:03  ---> logs-deploy.sh
16:16:03  Setup pyenv:
16:16:03    system
16:16:03    3.8.13
16:16:03    3.9.13
16:16:03  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
16:16:03  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-yNDH from file:/tmp/.os_lf_venv
16:16:03  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
16:16:07  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
16:16:20  lf-activate-venv(): INFO: Adding /tmp/venv-yNDH/bin to PATH
16:16:20  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63725
16:16:20  INFO: archiving workspace using pattern(s): 
16:16:26  Archives upload complete.
16:16:26  INFO: archiving logs to Nexus
16:16:27  ---> uname -a:
16:16:27  Linux prd-centos8-builder-2c-4g-2313.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
16:16:27  
16:16:27  
16:16:27  ---> lscpu:
16:16:27  Architecture:        x86_64
16:16:27  CPU op-mode(s):      32-bit, 64-bit
16:16:27  Byte Order:          Little Endian
16:16:27  CPU(s):              2
16:16:27  On-line CPU(s) list: 0,1
16:16:27  Thread(s) per core:  1
16:16:27  Core(s) per socket:  1
16:16:27  Socket(s):           2
16:16:27  NUMA node(s):        1
16:16:27  Vendor ID:           AuthenticAMD
16:16:27  CPU family:          23
16:16:27  Model:               49
16:16:27  Model name:          AMD EPYC-Rome Processor
16:16:27  Stepping:            0
16:16:27  CPU MHz:             2799.998
16:16:27  BogoMIPS:            5599.99
16:16:27  Virtualization:      AMD-V
16:16:27  Hypervisor vendor:   KVM
16:16:27  Virtualization type: full
16:16:27  L1d cache:           32K
16:16:27  L1i cache:           32K
16:16:27  L2 cache:            512K
16:16:27  L3 cache:            16384K
16:16:27  NUMA node0 CPU(s):   0,1
16:16:27  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
16:16:27  
16:16:27  
16:16:27  ---> nproc:
16:16:27  2
16:16:27  
16:16:27  
16:16:27  ---> df -h:
16:16:27  Filesystem      Size  Used Avail Use% Mounted on
16:16:27  devtmpfs        1.8G     0  1.8G   0% /dev
16:16:27  tmpfs           1.8G     0  1.8G   0% /dev/shm
16:16:27  tmpfs           1.8G   17M  1.8G   1% /run
16:16:27  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
16:16:27  /dev/vda1        20G   15G  5.4G  74% /
16:16:27  tmpfs           367M     0  367M   0% /run/user/1001
16:16:27  
16:16:27  
16:16:27  ---> free -m:
16:16:27                total        used        free      shared  buff/cache   available
16:16:27  Mem:           3665         498        1189          17        1977        2826
16:16:27  Swap:          1023           1        1022
16:16:27  
16:16:27  
16:16:27  ---> ip addr:
16:16:27  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
16:16:27      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
16:16:27      inet 127.0.0.1/8 scope host lo
16:16:27         valid_lft forever preferred_lft forever
16:16:27      inet6 ::1/128 scope host 
16:16:27         valid_lft forever preferred_lft forever
16:16:27  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
16:16:27      link/ether fa:16:3e:cb:2d:04 brd ff:ff:ff:ff:ff:ff
16:16:27      altname enp0s3
16:16:27      altname ens3
16:16:27      inet 10.32.6.99/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
16:16:27         valid_lft 85663sec preferred_lft 85663sec
16:16:27      inet6 fe80::f816:3eff:fecb:2d04/64 scope link 
16:16:27         valid_lft forever preferred_lft forever
16:16:27  
16:16:27  
16:16:27  ---> sar -b -r -n DEV:
16:16:27  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/09/2026 	_x86_64_	(2 CPU)
16:16:27  
16:16:27  16:03:46     LINUX RESTART	(2 CPU)
16:16:27  
16:16:27  04:05:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
16:16:27  04:06:01 PM     54.35      6.22     48.14    941.92   5147.39
16:16:27  04:07:01 PM     64.87      0.72     64.16    201.57   9311.50
16:16:27  04:08:01 PM     43.57      0.50     43.07     60.65  12133.02
16:16:27  04:09:01 PM     43.79      0.08     43.70      2.27  24770.38
16:16:27  04:10:01 PM    116.01      5.75    110.26    362.43 159032.38
16:16:27  04:11:01 PM    124.10      5.91    118.19    408.39 164747.55
16:16:27  04:12:01 PM     74.05      3.03     71.02    403.67  36931.23
16:16:27  04:13:01 PM     84.91      0.08     84.82      2.67   2231.87
16:16:27  04:14:01 PM     73.04      0.03     73.00      1.07   1975.32
16:16:27  04:15:01 PM     80.31      0.47     79.84     12.66   2119.14
16:16:27  04:16:01 PM    130.11    103.22     26.89   8930.76    844.87
16:16:27  Average:        80.87     11.46     69.41   1029.94  38171.12
16:16:27  
16:16:27  04:05:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
16:16:27  04:06:01 PM   1350024   3004432   2403660     64.03      2104   1823276    618180     12.87    137828   1978760    142824
16:16:27  04:07:01 PM   1042228   2951080   2711456     72.23      2104   2068164    644672     13.42    138764   2249072    161692
16:16:27  04:08:01 PM    761100   2850616   2992584     79.72      2104   2246312    737912     15.37    158392   2501120     97960
16:16:27  04:09:01 PM    105952   2844960   3647732     97.18      2104   2897812    745064     15.51    188048   3129192    194952
16:16:27  04:10:01 PM    123288   2796808   3630396     96.72      2104   2826432    801412     16.69    236520   3067880    144124
16:16:27  04:11:01 PM    147816   2775904   3605868     96.06      2104   2774568    861836     17.95    290408   3021112    160728
16:16:27  04:12:01 PM   1556724   2890520   2196960     58.53      2104   1481728    739456     15.40    185740   1715636      3388
16:16:27  04:13:01 PM   1493484   2844920   2260200     60.21      2104   1500836    769264     16.02    193512   1756852      3736
16:16:27  04:14:01 PM   1427976   2787152   2325708     61.96      2104   1517008    807344     16.81    199984   1803572      3028
16:16:27  04:15:01 PM   1360680   2719644   2393004     63.75      2104   1535016    845532     17.61    207376   1850484      3804
16:16:27  04:16:01 PM   1214156   2860992   2539528     67.65      2104   1820872    699100     14.56    226860   1965612     21464
16:16:27  Average:       962130   2847912   2791554     74.37      2104   2044729    751797     15.66    196676   2276299     85245
16:16:27  
16:16:27  04:05:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
16:16:27  04:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:06:01 PM      eth0     46.80     39.34    910.38      4.65      0.00      0.00      0.00      0.00
16:16:27  04:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:07:01 PM      eth0     65.67     57.39   1021.62      7.07      0.00      0.00      0.00      0.00
16:16:27  04:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:08:01 PM      eth0     41.97     38.72    736.89      5.94      0.00      0.00      0.00      0.00
16:16:27  04:09:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:09:01 PM      eth0    260.38    200.40   6322.33     16.33      0.00      0.00      0.00      0.00
16:16:27  04:10:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:10:01 PM      eth0   1671.19   1263.61  39448.27     96.56      0.00      0.00      0.00      0.00
16:16:27  04:11:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:11:01 PM      eth0   1793.95   1361.71  41481.20     93.10      0.00      0.00      0.00      0.00
16:16:27  04:12:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:12:01 PM      eth0    411.33    289.10   7829.84     25.42      0.00      0.00      0.00      0.00
16:16:27  04:13:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:13:01 PM      eth0     51.83     35.19    118.80     12.34      0.00      0.00      0.00      0.00
16:16:27  04:14:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:14:01 PM      eth0     42.84     30.28    103.13     10.49      0.00      0.00      0.00      0.00
16:16:27  04:15:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:15:01 PM      eth0     46.48     32.68    104.41     11.52      0.00      0.00      0.00      0.00
16:16:27  04:16:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  04:16:01 PM      eth0     17.14     15.48     13.32      7.49      0.00      0.00      0.00      0.00
16:16:27  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:16:27  Average:         eth0    405.14    306.28   8931.49     26.48      0.00      0.00      0.00      0.00
16:16:27  
16:16:27  
16:16:27  ---> sar -P ALL:
16:16:27  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/09/2026 	_x86_64_	(2 CPU)
16:16:27  
16:16:27  16:03:46     LINUX RESTART	(2 CPU)
16:16:27  
16:16:27  04:05:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:16:27  04:06:01 PM     all     24.19      0.00      3.16      1.67      0.08     70.90
16:16:27  04:06:01 PM       0     22.49      0.00      3.46      1.85      0.08     72.11
16:16:27  04:06:01 PM       1     25.89      0.00      2.85      1.49      0.08     69.68
16:16:27  04:07:01 PM     all     23.11      0.00      3.34      2.92      0.08     70.55
16:16:27  04:07:01 PM       0     18.48      0.00      3.06      3.26      0.07     75.14
16:16:27  04:07:01 PM       1     27.74      0.00      3.62      2.59      0.08     65.98
16:16:27  04:08:01 PM     all     30.50      0.00      2.80      1.05      0.08     65.56
16:16:27  04:08:01 PM       0     14.37      0.00      2.34      1.35      0.07     81.88
16:16:27  04:08:01 PM       1     46.64      0.00      3.27      0.75      0.10     49.24
16:16:27  04:09:01 PM     all     23.33      0.00      3.48      1.53      0.08     71.58
16:16:27  04:09:01 PM       0     18.62      0.00      3.80      0.97      0.07     76.54
16:16:27  04:09:01 PM       1     28.02      0.00      3.17      2.09      0.08     66.64
16:16:27  04:10:01 PM     all     24.63      0.00     11.78      3.04      0.11     60.44
16:16:27  04:10:01 PM       0     24.34      0.00     13.56      3.30      0.12     58.68
16:16:27  04:10:01 PM       1     24.92      0.00     10.03      2.78      0.10     62.18
16:16:27  04:11:01 PM     all     20.86      0.00     12.22      3.17      0.10     63.65
16:16:27  04:11:01 PM       0     25.31      0.00     14.58      3.08      0.10     56.92
16:16:27  04:11:01 PM       1     16.49      0.00      9.89      3.25      0.10     70.27
16:16:27  04:12:01 PM     all     32.80      0.00      3.77      1.05      0.11     62.27
16:16:27  04:12:01 PM       0     28.46      0.00      3.66      1.07      0.10     66.71
16:16:27  04:12:01 PM       1     37.12      0.00      3.88      1.04      0.12     57.85
16:16:27  04:13:01 PM     all     38.97      0.00      1.57      0.58      0.12     58.77
16:16:27  04:13:01 PM       0     23.51      0.00      1.35      0.48      0.10     74.56
16:16:27  04:13:01 PM       1     54.44      0.00      1.79      0.67      0.13     42.97
16:16:27  04:14:01 PM     all     40.42      0.00      1.34      0.34      0.11     57.78
16:16:27  04:14:01 PM       0      8.27      0.00      0.95      0.07      0.07     90.64
16:16:27  04:14:01 PM       1     72.55      0.00      1.74      0.62      0.15     24.95
16:16:27  04:15:01 PM     all     39.54      0.00      1.47      0.44      0.11     58.44
16:16:27  04:15:01 PM       0     15.43      0.00      1.15      0.38      0.08     82.95
16:16:27  04:15:01 PM       1     63.61      0.00      1.79      0.50      0.13     33.97
16:16:27  04:16:01 PM     all     28.73      0.38      3.37      7.37      0.09     60.06
16:16:27  04:16:01 PM       0     13.92      0.58      2.86      6.57      0.08     75.99
16:16:27  04:16:01 PM       1     43.56      0.17      3.88      8.18      0.10     44.11
16:16:27  
16:16:27  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
16:16:27  Average:        all     29.76      0.03      4.38      2.10      0.10     63.63
16:16:27  Average:          0     19.36      0.05      4.59      2.03      0.09     73.89
16:16:27  Average:          1     40.11      0.02      4.17      2.18      0.11     53.41
16:16:27  
16:16:27  
16:16:27