22:04:43  Started by timer
22:04:43  Running as SYSTEM
22:04:43  [EnvInject] - Loading node environment variables.
22:04:43  Building remotely on prd-centos8-builder-2c-4g-2265 (centos8-builder-2c-4g) in workspace /w/workspace/ci-management-openstack-cron
22:04:43  [ssh-agent] Looking for ssh-agent implementation...
22:04:43  $ ssh-agent
22:04:43  SSH_AUTH_SOCK=/tmp/ssh-KfZDfVVzE2as/agent.5171
22:04:43  SSH_AGENT_PID=5173
22:04:43  [ssh-agent] Started.
22:04:43  Running ssh-add (command line suppressed)
22:04:43  Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_655262145179787912.key (jenkins-ssh)
22:04:43  [ssh-agent] Using credentials jenkins (jenkins)
22:04:43  The recommended git tool is: NONE
22:04:45  using credential jenkins
22:04:45  Wiping out workspace first.
22:04:45  Cloning the remote Git repository
22:04:45  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:45   > git init /w/workspace/ci-management-openstack-cron # timeout=10
22:04:45  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
22:04:45   > git --version # timeout=10
22:04:45   > git --version # 'git version 2.43.0'
22:04:45  using GIT_SSH to set credentials jenkins
22:04:45  [INFO] Currently running in a labeled security context
22:04:45  [INFO] Currently SELinux is 'enforcing' on the host
22:04:45   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh4533050728516553860.key
22:04:45   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:49   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
22:04:49   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
22:04:50  Avoid second fetch
22:04:50   > git rev-parse refs/remotes/origin/master^{commit} # timeout=10
22:04:50  Checking out Revision bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 (refs/remotes/origin/master)
22:04:50   > git config core.sparsecheckout # timeout=10
22:04:50   > git checkout -f bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:50  Commit message: "CI: Update github2gerrit caller to v2.4.4"
22:04:50   > git rev-list --no-walk bd99cd2464adefc9a39aad8ae16df0732cbbfdc8 # timeout=10
22:04:50   > git remote # timeout=10
22:04:50   > git submodule init # timeout=10
22:04:50   > git submodule sync # timeout=10
22:04:51   > git config --get remote.origin.url # timeout=10
22:04:51   > git submodule init # timeout=10
22:04:51   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
22:04:51   > git config --get submodule.packer/common-packer.url # timeout=10
22:04:51   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
22:04:51   > git config --get submodule.global-jjb.url # timeout=10
22:04:51   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
22:04:51   > git submodule update --init --recursive packer/common-packer # timeout=10
22:04:55   > git submodule update --init --recursive global-jjb # timeout=10
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [Execute shell]
22:05:05  Run condition [Boolean condition] enabling prebuild for step [BuilderChain]
22:05:05  provisioning config files...
22:05:05  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
22:05:05  copy managed file [npmrc] to file:/home/jenkins/.npmrc
22:05:05  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
22:05:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins872508073168884756.sh
22:05:05  ---> python-tools-install.sh
22:05:05  Setup pyenv:
22:05:05    system
22:05:05  * 3.8.13 (set by /opt/pyenv/version)
22:05:05  * 3.9.13 (set by /opt/pyenv/version)
22:05:05  * 3.10.6 (set by /opt/pyenv/version)
22:05:10  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-auWY
22:05:10  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
22:05:10  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:05:21  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:05:57  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:05:57  Generating Requirements File
22:06:42  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:06:42  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:06:42  httplib2 0.30.2 requires pyparsing<4,>=3.0.4, but you have pyparsing 2.4.7 which is incompatible.
22:06:42  Python 3.10.6
22:06:42  pip 26.3 from /tmp/venv-auWY/lib/python3.10/site-packages/pip (python 3.10)
22:06:43  aiohappyeyeballs==2.7.1
22:06:43  aiohttp==3.14.5
22:06:43  aiosignal==1.4.0
22:06:43  appdirs==1.4.4
22:06:43  argcomplete==3.7.2
22:06:43  aspy.yaml==1.3.0
22:06:43  async-timeout==5.0.1
22:06:43  attrs==26.1.0
22:06:43  autopage==0.6.0
22:06:43  backports.strenum==1.3.1
22:06:43  beautifulsoup4==4.15.0
22:06:43  boto3==1.43.126
22:06:43  botocore==1.43.126
22:06:43  bs4==0.0.2
22:06:43  certifi==2026.10.23
22:06:43  cffi==2.1.1
22:06:43  cfgv==3.5.0
22:06:43  chardet==7.7.0
22:06:43  charset-normalizer==3.5.2
22:06:43  click==8.5.1
22:06:43  cliff==4.14.0
22:06:43  cmd2==3.5.1
22:06:43  cryptography==3.3.2
22:06:43  debtcollector==3.1.0
22:06:43  decorator==5.3.1
22:06:43  defusedxml==0.7.1
22:06:43  Deprecated==1.3.1
22:06:43  distlib==0.4.4
22:06:43  dnspython==2.8.0
22:06:43  docker==7.2.0
22:06:43  dogpile.cache==1.5.0
22:06:43  durationpy==0.11
22:06:43  email-validator==2.3.0
22:06:43  filelock==4.1.0
22:06:43  frozenlist==1.8.0
22:06:43  future==1.0.0
22:06:43  gitdb==4.0.12
22:06:43  GitPython==3.2.1
22:06:43  httplib2==0.30.2
22:06:43  identify==2.6.20
22:06:43  idna==3.20
22:06:43  importlib-resources==1.5.0
22:06:43  iso8601==2.1.0
22:06:43  Jinja2==3.1.6
22:06:43  jmespath==1.1.0
22:06:43  jsonpatch==1.44
22:06:43  jsonpointer==3.10
22:06:43  jsonschema==4.26.0
22:06:43  jsonschema-specifications==2025.9.1
22:06:43  keystoneauth1==5.14.0
22:06:43  kubernetes==36.0.3
22:06:43  lftools==0.37.26
22:06:43  lxml==6.1.3
22:06:43  markdown-it-py==4.2.0
22:06:43  MarkupSafe==3.0.4
22:06:43  mdurl==0.1.2
22:06:43  msgpack==1.2.4
22:06:43  multi_key_dict==2.0.4
22:06:43  multidict==7.1.0
22:06:43  munch==4.0.0
22:06:43  netaddr==1.3.0
22:06:43  niet==1.4.2
22:06:43  nodeenv==1.12.0
22:06:43  oauth2client==4.1.3
22:06:43  oauthlib==4.0.1
22:06:43  openstacksdk==4.13.0
22:06:43  os-service-types==1.8.2
22:06:43  osc-lib==4.6.0
22:06:43  oslo.config==10.4.0
22:06:43  oslo.context==6.4.0
22:06:43  oslo.i18n==6.8.0
22:06:43  oslo.log==8.2.0
22:06:43  oslo.serialization==5.10.0
22:06:43  oslo.utils==10.1.1
22:06:43  packaging==26.3
22:06:43  pbr==7.1.3
22:06:43  platformdirs==4.12.4
22:06:43  prettytable==3.18.0
22:06:43  propcache==0.5.4
22:06:43  psutil==7.2.2
22:06:43  pyasn1==0.6.5
22:06:43  pyasn1_modules==0.4.2
22:06:43  pycparser==3.11
22:06:43  pygerrit2==2.0.15
22:06:43  PyGithub==2.10.0
22:06:43  Pygments==2.21.0
22:06:43  PyJWT==2.15.1
22:06:43  PyNaCl==1.6.2
22:06:43  pyparsing==2.4.7
22:06:43  pyperclip==1.11.0
22:06:43  pyrsistent==0.20.0
22:06:43  python-cinderclient==9.9.0
22:06:43  python-dateutil==3.0.0
22:06:43  python-discovery==1.9.5
22:06:43  python-heatclient==5.2.0
22:06:43  python-jenkins==1.8.3
22:06:43  python-keystoneclient==6.0.0
22:06:43  python-magnumclient==4.11.0
22:06:43  python-openstackclient==10.0.0
22:06:43  python-swiftclient==4.11.0
22:06:43  PyYAML==6.0.3
22:06:43  referencing==0.37.0
22:06:43  requests==2.34.2
22:06:43  requests-oauthlib==2.0.0
22:06:43  rfc3986==2.0.0
22:06:43  rich==15.0.0
22:06:43  rich-argparse==1.8.0
22:06:43  rpds-py==0.30.0
22:06:43  rsa==4.9.1
22:06:43  ruamel.yaml==0.19.1
22:06:43  ruamel.yaml.clib==0.2.15
22:06:43  s3transfer==0.19.3
22:06:43  simplejson==4.2.0
22:06:43  six==1.17.0
22:06:43  smmap==5.0.3
22:06:43  soupsieve==2.10
22:06:43  stevedore==5.8.0
22:06:43  tabulate==0.10.0
22:06:43  toml==0.10.2
22:06:43  tomlkit==0.15.2
22:06:43  tqdm==4.70.1
22:06:43  typing_extensions==4.16.0
22:06:43  tzdata==2026.6
22:06:43  urllib3==1.26.20
22:06:43  virtualenv==21.15.6
22:06:43  wcwidth==0.9.4
22:06:43  websocket-client==1.9.2
22:06:43  wrapt==2.5.2
22:06:43  xdg==6.0.0
22:06:43  xmltodict==1.0.4
22:06:43  yarl==1.25.1
22:06:43  yq==4.4.5
22:06:43  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins10856910677528810581.sh
22:06:43  ---> uv-install.sh
22:06:43  Installing uv/uvx (latest) using shell installer
22:06:49  2026-11-08 22:06:49 URL:https://releases.astral.sh/installers/uv/latest/uv-installer.sh [71300/71300] -> "/tmp/uv-install-s2Xiid.sh" [1]
22:06:49  downloading uv 0.13.7 x86_64-unknown-linux-gnu
22:06:53  installing to /home/jenkins/.local/bin
22:06:53    uv
22:06:53    uvx
22:06:53  everything's installed!
22:06:53  ---> Validating uv/uvx install
22:06:53  uvx 0.13.7 (x86_64-unknown-linux-gnu)
22:06:53  [EnvInject] - Injecting environment variables from a build step.
22:06:54  [EnvInject] - Injecting as environment variables the properties content 
22:06:54  OS_CLOUD=vex
22:06:54  
22:06:54  [EnvInject] - Variables injected successfully.
22:06:54  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:06:54  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:06:54  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins11185881204889655198.sh
22:06:54  ---> Orphaned k8s clusters
22:06:54  Setup pyenv:
22:06:54    system
22:06:54    3.8.13
22:06:54    3.9.13
22:06:54  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:06:54  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:06:54  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:06:59  lf-activate-venv(): INFO: Installing additional packages: kubernetes python-heatclient python-openstackclient python-magnumclient 
22:07:25  ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
22:07:25  botocore 1.43.126 requires python-dateutil<3.0.0,>=2.1, but you have python-dateutil 3.0.0 which is incompatible.
22:07:26  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:07:36  -----> Delete orphaned cluster
22:07:36  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:07:36  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:07:36  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins7379236488746233225.sh
22:07:36  ---> Orphaned stacks
22:07:36  Setup pyenv:
22:07:36    system
22:07:36    3.8.13
22:07:36    3.9.13
22:07:36  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:07:36  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:07:36  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:07:41  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient urllib3~=1.26.15 yq 
22:08:12  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:08:12  + mapfile -t OS_COE_CLUSTERS_ID
22:08:12  ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)'
22:08:12  ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name
22:08:12  ++ awk '{print $1}'
22:08:24  + echo '-----> Active clusters -> stacks'
22:08:24  -----> Active clusters -> stacks
22:08:24  + OS_COE_STACKS=()
22:08:24  + [[ 0 -gt 0 ]]
22:08:24  + mapfile -t OS_STACKS
22:08:24  ++ awk '{print $1}'
22:08:24  ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED
22:08:32  + echo '-----> Active stacks'
22:08:32  -----> Active stacks
22:08:32  + echo '-----> Delete orphaned stacks'
22:08:32  -----> Delete orphaned stacks
22:08:32  [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True)
22:08:32  Run condition [Boolean condition] enabling perform for step [Execute shell]
22:08:32  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15245066920212914365.sh
22:08:32  ---> Orphaned servers
22:08:32  Setup pyenv:
22:08:32    system
22:08:32    3.8.13
22:08:32    3.9.13
22:08:32  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:08:32  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:08:32  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:08:38  lf-activate-venv(): INFO: Installing additional packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:11:16  ERROR: Could not install packages due to an OSError: [Errno 28] No space left on device
22:11:16  
22:11:18  lf-venv-pip-install(): WARNING: install failed from the configured index, retrying against https://pypi.org/simple
22:15:05  Build timed out (after 10 minutes). Marking the build as failed.
22:15:05  $ ssh-agent -k
22:15:05  unset SSH_AUTH_SOCK;
22:15:05  unset SSH_AGENT_PID;
22:15:05  echo Agent pid 5173 killed;
22:15:05  [ssh-agent] Stopped.
22:15:05  Build was aborted
22:15:05  [PostBuildScript] - [INFO] Executing post build scripts.
22:15:05  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins9908546403903330440.sh
22:15:05  ---> sysstat.sh
22:15:05  /home/jenkins/lf-env.sh: line 73:  6636 Terminated              "$venv_python" -m pip install --index-url "$upstream" "$@"
22:15:05  lf-activate-venv(): ERROR: Failed to install packages: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 
22:15:05  /tmp/jenkins15245066920212914365.sh: line 67: openstack: command not found
22:15:05  -----> Active servers
22:15:05  -----> Delete orphaned servers
22:15:06  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins6046573980853628035.sh
22:15:06  ---> package-listing.sh
22:15:06  ++ facter osfamily
22:15:06  ++ tr '[:upper:]' '[:lower:]'
22:15:07  + OS_FAMILY=redhat
22:15:07  + workspace=/w/workspace/ci-management-openstack-cron
22:15:07  + START_PACKAGES=/tmp/packages_start.txt
22:15:07  + END_PACKAGES=/tmp/packages_end.txt
22:15:07  + DIFF_PACKAGES=/tmp/packages_diff.txt
22:15:07  + PACKAGES=/tmp/packages_start.txt
22:15:07  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:07  + PACKAGES=/tmp/packages_end.txt
22:15:07  + case "${OS_FAMILY}" in
22:15:07  + rpm -qa
22:15:07  + sort
22:15:14  + '[' -f /tmp/packages_start.txt ']'
22:15:14  + '[' -f /tmp/packages_end.txt ']'
22:15:14  + diff /tmp/packages_start.txt /tmp/packages_end.txt
22:15:14  + '[' /w/workspace/ci-management-openstack-cron ']'
22:15:14  + mkdir -p /w/workspace/ci-management-openstack-cron/archives/
22:15:14  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/
22:15:14  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins2664423515007589571.sh
22:15:14  ---> capture-instance-metadata.sh
22:15:14  Setup pyenv:
22:15:14    system
22:15:14    3.8.13
22:15:14    3.9.13
22:15:14  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:14  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:15:14  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:19  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:34  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:15:34  INFO: Running in OpenStack, capturing instance metadata
22:15:34  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18213194196223613249.sh
22:15:34  provisioning config files...
22:15:34  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config11668687814146327653tmp
22:15:34  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
22:15:34  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
22:15:34  [EnvInject] - Injecting environment variables from a build step.
22:15:34  [EnvInject] - Injecting as environment variables the properties content 
22:15:34  SERVER_ID=logs
22:15:34  
22:15:34  [EnvInject] - Variables injected successfully.
22:15:34  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins8337320952649681110.sh
22:15:34  ---> create-netrc.sh
22:15:35  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12495003225724784168.sh
22:15:35  ---> python-tools-install.sh
22:15:35  Setup pyenv:
22:15:35    system
22:15:35    3.8.13
22:15:35    3.9.13
22:15:35  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:35  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:15:35  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:15:40  lf-activate-venv(): INFO: Installing additional packages: lftools 
22:15:55  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:15:55  [ci-management-openstack-cron] $ /bin/sh /tmp/jenkins4305136186008574238.sh
22:15:55  ---> uv-install.sh
22:15:55  uv 0.13.7 is already installed
22:15:55  uvx 0.13.7 (x86_64-unknown-linux-gnu)
22:15:55  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins15953667677441713319.sh
22:15:55  ---> sudo-logs.sh
22:15:55  Archiving 'sudo' log..
22:15:55  [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins11882754353122825540.sh
22:15:55  ---> job-cost.sh
22:15:55  INFO: Activating Python virtual environment...
22:15:55  Setup pyenv:
22:15:55    system
22:15:55    3.8.13
22:15:55    3.9.13
22:15:55  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:15:56  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:15:56  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:16:01  lf-activate-venv(): INFO: Installing additional packages: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
22:16:12  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:16:12  INFO: No stack-cost file found
22:16:12  INFO: Instance uptime: 749s
22:16:12  INFO: Fetching instance metadata (attempt 1 of 3)...
22:16:12  DEBUG: URL: http://169.254.169.254/latest/meta-data/instance-type
22:16:12  INFO: Successfully fetched instance metadata
22:16:12  INFO: Instance type: v3-starter-2
22:16:12  INFO: Retrieving pricing info for: v3-starter-2
22:16:12  INFO: Fetching Vexxhost pricing API (attempt 1 of 3)...
22:16:12  DEBUG: URL: https://pricing.vexxhost.net/v1/pricing/v3-starter-2/cost?seconds=749
22:16:16  INFO: Successfully fetched Vexxhost pricing API
22:16:16  INFO: Retrieved cost: 0.02
22:16:16  INFO: Retrieved resource: v3-starter-2
22:16:16  INFO: Creating archive directory: /w/workspace/ci-management-openstack-cron/archives/cost
22:16:16  INFO: Archiving costs to: /w/workspace/ci-management-openstack-cron/archives/cost.csv
22:16:16  INFO: Successfully archived job cost data
22:16:16  DEBUG: Cost data: ci-management-openstack-cron,63707,2026-11-08 22:16:16,v3-starter-2,749,0.02,0.00,FAILURE
22:16:16  [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins409531208895371501.sh
22:16:16  ---> logs-deploy.sh
22:16:16  Setup pyenv:
22:16:16    system
22:16:16    3.8.13
22:16:16    3.9.13
22:16:16  * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version)
22:16:16  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-auWY from file:/tmp/.os_lf_venv
22:16:16  lf-activate-venv(): INFO: Installing base packages (pip, setuptools, virtualenv)
22:16:21  lf-activate-venv(): INFO: Installing additional packages: lftools urllib3~=1.26.15 
22:16:36  lf-activate-venv(): INFO: Adding /tmp/venv-auWY/bin to PATH
22:16:36  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/63707
22:16:36  INFO: archiving workspace using pattern(s): 
22:16:42  Archives upload complete.
22:16:42  INFO: archiving logs to Nexus
22:16:43  ---> uname -a:
22:16:43  Linux prd-centos8-builder-2c-4g-2265.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
22:16:43  
22:16:43  
22:16:43  ---> lscpu:
22:16:43  Architecture:        x86_64
22:16:43  CPU op-mode(s):      32-bit, 64-bit
22:16:43  Byte Order:          Little Endian
22:16:43  CPU(s):              2
22:16:43  On-line CPU(s) list: 0,1
22:16:43  Thread(s) per core:  1
22:16:43  Core(s) per socket:  1
22:16:43  Socket(s):           2
22:16:43  NUMA node(s):        1
22:16:43  Vendor ID:           AuthenticAMD
22:16:43  CPU family:          23
22:16:43  Model:               49
22:16:43  Model name:          AMD EPYC-Rome Processor
22:16:43  Stepping:            0
22:16:43  CPU MHz:             2799.998
22:16:43  BogoMIPS:            5599.99
22:16:43  Virtualization:      AMD-V
22:16:43  Hypervisor vendor:   KVM
22:16:43  Virtualization type: full
22:16:43  L1d cache:           32K
22:16:43  L1i cache:           32K
22:16:43  L2 cache:            512K
22:16:43  L3 cache:            16384K
22:16:43  NUMA node0 CPU(s):   0,1
22:16:43  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
22:16:43  
22:16:43  
22:16:43  ---> nproc:
22:16:43  2
22:16:43  
22:16:43  
22:16:43  ---> df -h:
22:16:43  Filesystem      Size  Used Avail Use% Mounted on
22:16:43  devtmpfs        1.8G     0  1.8G   0% /dev
22:16:43  tmpfs           1.8G     0  1.8G   0% /dev/shm
22:16:43  tmpfs           1.8G   17M  1.8G   1% /run
22:16:43  tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
22:16:43  /dev/vda1        20G   15G  5.4G  74% /
22:16:43  tmpfs           367M     0  367M   0% /run/user/1001
22:16:43  
22:16:43  
22:16:43  ---> free -m:
22:16:43                total        used        free      shared  buff/cache   available
22:16:43  Mem:           3665         455        1251          17        1957        2909
22:16:43  Swap:          1023           0        1023
22:16:43  
22:16:43  
22:16:43  ---> ip addr:
22:16:43  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
22:16:43      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
22:16:43      inet 127.0.0.1/8 scope host lo
22:16:43         valid_lft forever preferred_lft forever
22:16:43      inet6 ::1/128 scope host 
22:16:43         valid_lft forever preferred_lft forever
22:16:43  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
22:16:43      link/ether fa:16:3e:76:f4:57 brd ff:ff:ff:ff:ff:ff
22:16:43      altname enp0s3
22:16:43      altname ens3
22:16:43      inet 10.32.7.8/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
22:16:43         valid_lft 85652sec preferred_lft 85652sec
22:16:43      inet6 fe80::f816:3eff:fe76:f457/64 scope link 
22:16:43         valid_lft forever preferred_lft forever
22:16:43  
22:16:43  
22:16:43  ---> sar -b -r -n DEV:
22:16:43  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/08/2026 	_x86_64_	(2 CPU)
22:16:43  
22:16:43  22:03:51     LINUX RESTART	(2 CPU)
22:16:43  
22:16:43  10:05:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
22:16:43  10:06:01 PM     67.03      6.36     60.66    933.16   5139.52
22:16:43  10:07:01 PM     60.43      0.70     59.73    201.53   8440.39
22:16:43  10:08:01 PM     44.79      0.50     44.29     60.66  12867.99
22:16:43  10:09:01 PM     34.66      0.05     34.61      1.33   4592.62
22:16:43  10:10:01 PM    109.71      1.40    108.31    279.72 155259.09
22:16:43  10:11:01 PM    127.65      4.48    123.17    401.33 174505.81
22:16:43  10:12:01 PM     71.84      3.41     68.42    473.68  51400.33
22:16:43  10:13:01 PM     66.21      0.08     66.12      2.67   1687.54
22:16:43  10:14:01 PM     60.61      0.08     60.53      2.67   1617.09
22:16:43  10:15:01 PM     59.81      0.17     59.65     28.66   1562.58
22:16:43  10:16:01 PM    113.50     90.77     22.73   8220.99    674.06
22:16:43  Average:        74.21      9.82     64.39    964.17  37989.58
22:16:43  
22:16:43  10:05:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
22:16:43  10:06:01 PM   1422708   3070032   2330976     62.10      2104   1816076    556644     11.59    135284   1907432    136812
22:16:43  10:07:01 PM   1114968   3015892   2638716     70.30      2104   2060208    582012     12.12    137940   2177720    178284
22:16:43  10:08:01 PM    851736   2919736   2901948     77.31      2104   2226148    668556     13.92    154472   2417712     76108
22:16:43  10:09:01 PM    810680   2873172   2943004     78.40      2104   2220512    716932     14.93    179684   2431944     88444
22:16:43  10:10:01 PM    104924   2824040   3648760     97.20      2104   2873204    764336     15.92    232800   3077124    245760
22:16:43  10:11:01 PM    144044   2817972   3609640     96.16      2104   2821372    818056     17.03    282488   3035100    148092
22:16:43  10:12:01 PM   1579060   2929972   2174624     57.93      2104   1499868    711220     14.81    181220   1701312      1968
22:16:43  10:13:01 PM   1539940   2909780   2213744     58.98      2104   1515004    719500     14.98    187320   1723700      3356
22:16:43  10:14:01 PM   1485676   2871924   2268008     60.42      2104   1528204    749660     15.61    192600   1762092      2628
22:16:43  10:15:01 PM   1433492   2834612   2320192     61.81      2104   1542032    780344     16.25    198628   1799752      3008
22:16:43  10:16:01 PM   1369796   3023876   2383888     63.51      2104   1795588    582616     12.13    215080   1838296      8368
22:16:43  Average:      1077911   2917364   2675773     71.28      2104   1990747    695443     14.48    190683   2170199     81166
22:16:43  
22:16:43  10:05:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
22:16:43  10:06:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:06:01 PM      eth0     50.47     42.82    868.33      5.83      0.00      0.00      0.00      0.00
22:16:43  10:07:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:07:01 PM      eth0     71.91     60.65   1042.67      6.98      0.00      0.00      0.00      0.00
22:16:43  10:08:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:08:01 PM      eth0     41.98     38.64    737.45      8.40      0.00      0.00      0.00      0.00
22:16:43  10:09:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:09:01 PM      eth0     25.59     22.74    272.18      4.63      0.00      0.00      0.00      0.00
22:16:43  10:10:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:10:01 PM      eth0   1700.18   1281.57  40195.16     87.26      0.00      0.00      0.00      0.00
22:16:43  10:11:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:11:01 PM      eth0   1973.78   1486.68  42997.01    101.53      0.00      0.00      0.00      0.00
22:16:43  10:12:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:12:01 PM      eth0    532.54    383.16  11628.11     30.20      0.00      0.00      0.00      0.00
22:16:43  10:13:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:13:01 PM      eth0     81.75     44.41     96.37     10.82      0.00      0.00      0.00      0.00
22:16:43  10:14:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:14:01 PM      eth0     69.81     40.04     84.60      9.55      0.00      0.00      0.00      0.00
22:16:43  10:15:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:15:01 PM      eth0     69.09     39.22     85.54      9.45      0.00      0.00      0.00      0.00
22:16:43  10:16:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  10:16:01 PM      eth0     20.11     15.09     17.69      7.19      0.00      0.00      0.00      0.00
22:16:43  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
22:16:43  Average:         eth0    421.70    314.20   8914.64     25.63      0.00      0.00      0.00      0.00
22:16:43  
22:16:43  
22:16:43  ---> sar -P ALL:
22:16:43  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	11/08/2026 	_x86_64_	(2 CPU)
22:16:43  
22:16:43  22:03:51     LINUX RESTART	(2 CPU)
22:16:43  
22:16:43  10:05:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:43  10:06:01 PM     all     22.78      0.00      3.35      2.09      0.08     71.71
22:16:43  10:06:01 PM       0     13.32      0.00      3.27      2.85      0.07     80.49
22:16:43  10:06:01 PM       1     32.23      0.00      3.43      1.32      0.08     62.94
22:16:43  10:07:01 PM     all     21.32      0.00      3.34      2.01      0.08     73.25
22:16:43  10:07:01 PM       0      7.83      0.00      2.50      1.90      0.07     87.70
22:16:43  10:07:01 PM       1     34.83      0.00      4.18      2.12      0.08     58.78
22:16:43  10:08:01 PM     all     28.32      0.00      2.81      1.48      0.08     67.31
22:16:43  10:08:01 PM       0     29.37      0.00      2.82      1.00      0.08     66.72
22:16:43  10:08:01 PM       1     27.27      0.00      2.80      1.95      0.08     67.90
22:16:43  10:09:01 PM     all     24.16      0.00      2.49      1.18      0.08     72.10
22:16:43  10:09:01 PM       0      4.29      0.00      1.68      1.95      0.07     92.01
22:16:43  10:09:01 PM       1     44.04      0.00      3.29      0.40      0.08     52.19
22:16:43  10:10:01 PM     all     24.24      0.00     11.50      2.98      0.11     61.17
22:16:43  10:10:01 PM       0     19.04      0.00      9.41      3.01      0.10     68.44
22:16:43  10:10:01 PM       1     29.49      0.00     13.61      2.96      0.12     53.82
22:16:43  10:11:01 PM     all     21.24      0.00     12.73      3.01      0.11     62.90
22:16:43  10:11:01 PM       0     13.87      0.00      9.32      2.65      0.10     74.06
22:16:43  10:11:01 PM       1     28.74      0.00     16.20      3.38      0.12     51.56
22:16:43  10:12:01 PM     all     26.25      0.00      4.65      1.36      0.09     67.65
22:16:43  10:12:01 PM       0     13.97      0.00      3.08      1.20      0.08     81.67
22:16:43  10:12:01 PM       1     38.58      0.00      6.23      1.51      0.10     53.57
22:16:43  10:13:01 PM     all     29.44      0.00      1.38      0.38      0.09     68.70
22:16:43  10:13:01 PM       0     19.46      0.00      1.17      0.17      0.08     79.12
22:16:43  10:13:01 PM       1     39.39      0.00      1.59      0.60      0.10     58.32
22:16:43  10:14:01 PM     all     31.65      0.00      1.24      0.29      0.08     66.74
22:16:43  10:14:01 PM       0     16.86      0.00      0.90      0.18      0.07     81.98
22:16:43  10:14:01 PM       1     46.42      0.00      1.57      0.40      0.10     51.51
22:16:43  10:15:01 PM     all     31.83      0.00      1.23      0.30      0.11     66.54
22:16:43  10:15:01 PM       0      7.75      0.00      0.80      0.03      0.08     91.32
22:16:43  10:15:01 PM       1     55.83      0.00      1.65      0.57      0.13     41.82
22:16:43  10:16:01 PM     all     24.39      0.00      2.76      6.26      0.08     66.49
22:16:43  10:16:01 PM       0     22.70      0.00      2.86      7.12      0.08     67.24
22:16:43  10:16:01 PM       1     26.09      0.00      2.67      5.41      0.08     65.75
22:16:43  
22:16:43  Average:        CPU     %user     %nice   %system   %iowait    %steal     %idle
22:16:43  Average:        all     25.97      0.00      4.30      1.94      0.09     67.70
22:16:43  Average:          0     15.31      0.00      3.43      2.01      0.08     79.17
22:16:43  Average:          1     36.65      0.00      5.16      1.87      0.10     56.21
22:16:43  
22:16:43  
22:16:43