16:44:14  Retriggered by user jwagantall for Gerrit: https://gerrit.o-ran-sc.org/r/c/ci-management/+/12860
16:44:14  Running as SYSTEM
16:44:14  [EnvInject] - Loading node environment variables.
16:44:14  Building remotely on prd-centos8-builder-1c-1g-2811 (centos8-builder-1c-1g) in workspace /w/workspace/ci-management-jenkins-cfg-verify
16:44:14  [ssh-agent] Looking for ssh-agent implementation...
16:44:14  ERROR Gerrit response: Conflict[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
16:44:15  $ ssh-agent
16:44:15  SSH_AUTH_SOCK=/tmp/ssh-5Y0QxNmhmDlU/agent.5177
16:44:15  SSH_AGENT_PID=5178
16:44:15  [ssh-agent] Started.
16:44:15  Running ssh-add (command line suppressed)
16:44:15  Identity added: /w/workspace/ci-management-jenkins-cfg-verify@tmp/private_key_5101614829599745464.key (jenkins-ssh)
16:44:15  [ssh-agent] Using credentials jenkins (jenkins)
16:44:15  The recommended git tool is: NONE
16:44:19  using credential jenkins
16:44:19  Wiping out workspace first.
16:44:19  Cloning the remote Git repository
16:44:19  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:44:19   > git init /w/workspace/ci-management-jenkins-cfg-verify # timeout=10
16:44:19  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:44:19   > git --version # timeout=10
16:44:19   > git --version # 'git version 2.43.0'
16:44:19  using GIT_SSH to set credentials jenkins
16:44:19  [INFO] Currently running in a labeled security context
16:44:19  [INFO] Currently SELinux is 'enforcing' on the host
16:44:19   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh18442155223461419269.key
16:44:19   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
16:44:21   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:44:21   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
16:44:21   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:44:21  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:44:21  using GIT_SSH to set credentials jenkins
16:44:21  [INFO] Currently running in a labeled security context
16:44:21  [INFO] Currently SELinux is 'enforcing' on the host
16:44:21   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh4934079636478775282.key
16:44:21   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management refs/changes/60/12860/1 # timeout=10
16:44:22   > git rev-parse 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3^{commit} # timeout=10
16:44:22  JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script
16:44:22  Checking out Revision 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3 (refs/changes/60/12860/1)
16:44:22   > git config core.sparsecheckout # timeout=10
16:44:22   > git checkout -f 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3 # timeout=10
16:44:22  Commit message: "Chore: Automation adds smo/teiv config files"
16:44:22   > git rev-parse FETCH_HEAD^{commit} # timeout=10
16:44:22   > git rev-list --no-walk 745cb85f56bdb45eb2fab69bc09387de5cc0b572 # timeout=10
16:44:22   > git remote # timeout=10
16:44:22   > git submodule init # timeout=10
16:44:23   > git submodule sync # timeout=10
16:44:23   > git config --get remote.origin.url # timeout=10
16:44:23   > git submodule init # timeout=10
16:44:23   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
16:44:23   > git config --get submodule.packer/common-packer.url # timeout=10
16:44:23   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
16:44:23   > git config --get submodule.global-jjb.url # timeout=10
16:44:23   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
16:44:23   > git submodule update --init --recursive packer/common-packer # timeout=10
16:44:32   > git submodule update --init --recursive global-jjb # timeout=10
16:44:36  provisioning config files...
16:44:36  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
16:44:36  copy managed file [npmrc] to file:/home/jenkins/.npmrc
16:44:36  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
16:44:36  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins9877428676194101593.sh
16:44:36  ---> python-tools-install.sh
16:44:36  Setup pyenv:
16:44:37    system
16:44:37  * 3.8.13 (set by /opt/pyenv/version)
16:44:37  * 3.9.13 (set by /opt/pyenv/version)
16:44:37  * 3.10.6 (set by /opt/pyenv/version)
16:44:41  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-8hUM
16:44:41  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
16:44:45  lf-activate-venv(): INFO: Installing: lftools 
16:45:17  lf-activate-venv(): INFO: Adding /tmp/venv-8hUM/bin to PATH
16:45:17  Generating Requirements File
16:45:41  Python 3.10.6
16:45:41  pip 24.0 from /tmp/venv-8hUM/lib/python3.10/site-packages/pip (python 3.10)
16:45:42  appdirs==1.4.4
16:45:42  argcomplete==3.3.0
16:45:42  aspy.yaml==1.3.0
16:45:42  attrs==23.2.0
16:45:42  autopage==0.5.2
16:45:42  beautifulsoup4==4.12.3
16:45:42  boto3==1.34.120
16:45:42  botocore==1.34.120
16:45:42  bs4==0.0.2
16:45:42  cachetools==5.3.3
16:45:42  certifi==2024.6.2
16:45:42  cffi==1.16.0
16:45:42  cfgv==3.4.0
16:45:42  chardet==5.2.0
16:45:42  charset-normalizer==3.3.2
16:45:42  click==8.1.7
16:45:42  cliff==4.7.0
16:45:42  cmd2==2.4.3
16:45:42  cryptography==3.3.2
16:45:42  debtcollector==3.0.0
16:45:42  decorator==5.1.1
16:45:42  defusedxml==0.7.1
16:45:42  Deprecated==1.2.14
16:45:42  distlib==0.3.8
16:45:42  dnspython==2.6.1
16:45:42  docker==4.2.2
16:45:42  dogpile.cache==1.3.3
16:45:42  email_validator==2.1.1
16:45:42  filelock==3.14.0
16:45:42  future==1.0.0
16:45:42  gitdb==4.0.11
16:45:42  GitPython==3.1.43
16:45:42  google-auth==2.29.0
16:45:42  httplib2==0.22.0
16:45:42  identify==2.5.36
16:45:42  idna==3.7
16:45:42  importlib-resources==1.5.0
16:45:42  iso8601==2.1.0
16:45:42  Jinja2==3.1.4
16:45:42  jmespath==1.0.1
16:45:42  jsonpatch==1.33
16:45:42  jsonpointer==2.4
16:45:42  jsonschema==4.22.0
16:45:42  jsonschema-specifications==2023.12.1
16:45:42  keystoneauth1==5.6.0
16:45:42  kubernetes==29.0.0
16:45:42  lftools==0.37.10
16:45:42  lxml==5.2.2
16:45:42  MarkupSafe==2.1.5
16:45:42  msgpack==1.0.8
16:45:42  multi_key_dict==2.0.3
16:45:42  munch==4.0.0
16:45:42  netaddr==1.3.0
16:45:42  netifaces==0.11.0
16:45:42  niet==1.4.2
16:45:42  nodeenv==1.9.1
16:45:42  oauth2client==4.1.3
16:45:42  oauthlib==3.2.2
16:45:42  openstacksdk==3.1.0
16:45:42  os-client-config==2.1.0
16:45:42  os-service-types==1.7.0
16:45:42  osc-lib==3.0.1
16:45:42  oslo.config==9.4.0
16:45:42  oslo.context==5.5.0
16:45:42  oslo.i18n==6.3.0
16:45:42  oslo.log==6.0.0
16:45:42  oslo.serialization==5.4.0
16:45:42  oslo.utils==7.1.0
16:45:42  packaging==24.0
16:45:42  pbr==6.0.0
16:45:42  platformdirs==4.2.2
16:45:42  prettytable==3.10.0
16:45:42  pyasn1==0.6.0
16:45:42  pyasn1_modules==0.4.0
16:45:42  pycparser==2.22
16:45:42  pygerrit2==2.0.15
16:45:42  PyGithub==2.3.0
16:45:42  PyJWT==2.8.0
16:45:42  PyNaCl==1.5.0
16:45:42  pyparsing==2.4.7
16:45:42  pyperclip==1.8.2
16:45:42  pyrsistent==0.20.0
16:45:42  python-cinderclient==9.5.0
16:45:42  python-dateutil==2.9.0.post0
16:45:42  python-heatclient==3.5.0
16:45:42  python-jenkins==1.8.2
16:45:42  python-keystoneclient==5.4.0
16:45:42  python-magnumclient==4.5.0
16:45:42  python-novaclient==18.6.0
16:45:42  python-openstackclient==6.6.0
16:45:42  python-swiftclient==4.6.0
16:45:42  PyYAML==6.0.1
16:45:42  referencing==0.35.1
16:45:42  requests==2.32.3
16:45:42  requests-oauthlib==2.0.0
16:45:42  requestsexceptions==1.4.0
16:45:42  rfc3986==2.0.0
16:45:42  rpds-py==0.18.1
16:45:42  rsa==4.9
16:45:42  ruamel.yaml==0.18.6
16:45:42  ruamel.yaml.clib==0.2.8
16:45:42  s3transfer==0.10.1
16:45:42  simplejson==3.19.2
16:45:42  six==1.16.0
16:45:42  smmap==5.0.1
16:45:42  soupsieve==2.5
16:45:42  stevedore==5.2.0
16:45:42  tabulate==0.9.0
16:45:42  toml==0.10.2
16:45:42  tomlkit==0.12.5
16:45:42  tqdm==4.66.4
16:45:42  typing_extensions==4.12.1
16:45:42  tzdata==2024.1
16:45:42  urllib3==1.26.18
16:45:42  virtualenv==20.26.2
16:45:42  wcwidth==0.2.13
16:45:42  websocket-client==1.8.0
16:45:42  wrapt==1.16.0
16:45:42  xdg==6.0.0
16:45:42  xmltodict==0.13.0
16:45:42  yq==3.4.3
16:45:42  [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins15429345274484805903.sh
16:45:42  ---> jenkins-verify-images.sh
16:45:42  + source /home/jenkins/lf-env.sh
16:45:42  + '[' -f /tmp/.os_lf_venv ']'
16:45:42  ++ cat /tmp/.os_lf_venv
16:45:42  + os_lf_venv=/tmp/venv-8hUM
16:45:42  + '[' -d /tmp/venv-8hUM ']'
16:45:42  + '[' -f /tmp/venv-8hUM/bin/openstack ']'
16:45:42  + echo 'Re-use existing venv: /tmp/venv-8hUM'
16:45:42  Re-use existing venv: /tmp/venv-8hUM
16:45:42  + PATH=/tmp/venv-8hUM/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
16:45:42  + error=false
16:45:42  + echo 'Verifying that cloud has a master configuration file'
16:45:42  Verifying that cloud has a master configuration file
16:45:42  + [[ -d jenkins-config/clouds/openstack ]]
16:45:42  + for cloud in jenkins-config/clouds/openstack/*
16:45:42  + [[ -f jenkins-config/clouds/openstack/cattle/cloud.cfg ]]
16:45:42  ++ grep -E '^OS_CLOUD=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:45:42  ++ cut -d= -f2
16:45:42  + os_cloud=
16:45:42  + os_cloud=vex
16:45:42  + OS_CLOUD=vex
16:45:42  + verify_images jenkins-config/clouds/openstack/cattle
16:45:42  + echo 'Verifying images on jenkins-config/clouds/openstack/cattle'
16:45:42  Verifying images on jenkins-config/clouds/openstack/cattle
16:45:42  + for file in "$1"/*
16:45:42  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg ']'
16:45:42  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg
16:45:42  + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:45:42  + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:45:42  + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:45:42  + grep active
16:45:46  | 4fab7a7c-385a-42b7-a11c-ffe686c5371c | ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228 | active |
16:45:46  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg
16:45:46  + export HARDWARE_ID=v2-highcpu-1
16:45:46  + HARDWARE_ID=v2-highcpu-1
16:45:46  + openstack flavor list
16:45:46  + grep ' v2-highcpu-1 '
16:45:48  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:45:48  + for file in "$1"/*
16:45:48  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg ']'
16:45:48  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg
16:45:48  + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:48  + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:48  + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:48  + grep active
16:45:51  | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active |
16:45:51  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg
16:45:51  + export HARDWARE_ID=v2-standard-2
16:45:51  + HARDWARE_ID=v2-standard-2
16:45:51  + openstack flavor list
16:45:51  + grep ' v2-standard-2 '
16:45:53  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:45:53  + for file in "$1"/*
16:45:53  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg ']'
16:45:53  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg
16:45:53  + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:53  + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:53  + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:45:53  + grep active
16:45:57  | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active |
16:45:57  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg
16:45:57  + export HARDWARE_ID=v2-standard-2
16:45:57  + HARDWARE_ID=v2-standard-2
16:45:57  + openstack flavor list
16:45:57  + grep ' v2-standard-2 '
16:45:59  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:45:59  + for file in "$1"/*
16:45:59  + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg ']'
16:45:59  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg
16:45:59  + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:45:59  + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:45:59  + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:45:59  + grep active
16:46:02  | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active |
16:46:02  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg
16:46:02  + export HARDWARE_ID=v2-highcpu-1
16:46:02  + HARDWARE_ID=v2-highcpu-1
16:46:02  + openstack flavor list
16:46:02  + grep ' v2-highcpu-1 '
16:46:04  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:46:04  + for file in "$1"/*
16:46:04  + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg ']'
16:46:04  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg
16:46:04  + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:46:04  + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:46:04  + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:46:04  + grep active
16:46:08  | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active |
16:46:08  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg
16:46:08  + export HARDWARE_ID=v2-standard-2
16:46:08  + HARDWARE_ID=v2-standard-2
16:46:08  + openstack flavor list
16:46:08  + grep ' v2-standard-2 '
16:46:10  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:46:10  + for file in "$1"/*
16:46:10  + '[' -f jenkins-config/clouds/openstack/cattle/cloud.cfg ']'
16:46:10  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:46:10  + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:46:10  + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:46:10  + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:46:10  + grep active
16:46:13  | 343bd23c-ed30-4138-b918-89afcc7604b1 | ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874 | active |
16:46:13  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:46:13  + export HARDWARE_ID=v2-highcpu-1
16:46:13  + HARDWARE_ID=v2-highcpu-1
16:46:13  + openstack flavor list
16:46:13  + grep ' v2-highcpu-1 '
16:46:15  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:46:15  + for file in "$1"/*
16:46:15  + '[' -f jenkins-config/clouds/openstack/cattle/releasenotes ']'
16:46:15  + for file in "$1"/*
16:46:15  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg ']'
16:46:15  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg
16:46:15  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:46:15  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:46:15  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:46:15  + grep active
16:46:19  | 5f051f05-de78-4696-a031-19f161e114c2 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546 | active |
16:46:19  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg
16:46:19  + export HARDWARE_ID=v2-highcpu-2
16:46:19  + HARDWARE_ID=v2-highcpu-2
16:46:19  + openstack flavor list
16:46:19  + grep ' v2-highcpu-2 '
16:46:21  | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2   |   2048 |    0 |         0 |     2 | True      |
16:46:21  + for file in "$1"/*
16:46:21  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg ']'
16:46:21  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg
16:46:21  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:46:21  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:46:21  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:46:21  + grep active
16:46:24  | df2201fe-3e7f-4b7a-9efe-dc672337afb0 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749 | active |
16:46:24  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg
16:46:24  + export HARDWARE_ID=v2-highcpu-4
16:46:24  + HARDWARE_ID=v2-highcpu-4
16:46:24  + openstack flavor list
16:46:24  + grep ' v2-highcpu-4 '
16:46:26  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:46:26  + for file in "$1"/*
16:46:26  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg ']'
16:46:26  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg
16:46:26  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:26  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:26  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:26  + grep active
16:46:29  | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active |
16:46:29  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg
16:46:29  + export HARDWARE_ID=v2-highcpu-4
16:46:29  + HARDWARE_ID=v2-highcpu-4
16:46:29  + openstack flavor list
16:46:29  + grep ' v2-highcpu-4 '
16:46:31  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:46:31  + for file in "$1"/*
16:46:31  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg ']'
16:46:31  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg
16:46:31  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:31  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:31  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:46:31  + grep active
16:46:35  | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active |
16:46:35  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg
16:46:35  + export HARDWARE_ID=v2-highcpu-4
16:46:35  + HARDWARE_ID=v2-highcpu-4
16:46:35  + openstack flavor list
16:46:35  + grep ' v2-highcpu-4 '
16:46:36  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:46:36  + for file in "$1"/*
16:46:36  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg ']'
16:46:36  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg
16:46:36  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:36  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:37  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:37  + grep active
16:46:40  | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active |
16:46:40  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg
16:46:40  + export HARDWARE_ID=v2-highcpu-2
16:46:40  + HARDWARE_ID=v2-highcpu-2
16:46:40  + openstack flavor list
16:46:40  + grep ' v2-highcpu-2 '
16:46:42  | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2   |   2048 |    0 |         0 |     2 | True      |
16:46:42  + for file in "$1"/*
16:46:42  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg ']'
16:46:42  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg
16:46:42  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:42  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:42  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:46:42  + grep active
16:46:45  | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active |
16:46:45  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg
16:46:45  + export HARDWARE_ID=v2-highcpu-4
16:46:45  + HARDWARE_ID=v2-highcpu-4
16:46:45  + openstack flavor list
16:46:45  + grep ' v2-highcpu-4 '
16:46:47  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:46:47  + for file in "$1"/*
16:46:47  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg ']'
16:46:47  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg
16:46:47  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:46:47  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:46:47  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:46:47  + grep active
16:46:50  | c962a012-598c-4b9f-a5a0-a5e2cfbaba77 | ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255 | active |
16:46:50  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg
16:46:50  + export HARDWARE_ID=v3-standard-4
16:46:50  + HARDWARE_ID=v3-standard-4
16:46:50  + openstack flavor list
16:46:50  + grep ' v3-standard-4 '
16:46:52  | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4  |  16384 |   80 |         0 |     4 | True      |
16:46:52  + for file in "$1"/*
16:46:52  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg ']'
16:46:52  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg
16:46:52  + export 'IMAGE_NAME=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:46:52  + IMAGE_NAME='ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:46:52  + openstack image list --property 'name=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:46:52  + grep active
16:46:55  | a6f6b7c5-9e94-4781-8f55-24b20e6a598f | ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118 | active |
16:46:55  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg
16:46:55  + export HARDWARE_ID=v3-standard-4
16:46:55  + HARDWARE_ID=v3-standard-4
16:46:55  + openstack flavor list
16:46:55  + grep ' v3-standard-4 '
16:46:57  | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4  |  16384 |   80 |         0 |     4 | True      |
16:46:57  + false
16:46:58  $ ssh-agent -k
16:46:58  unset SSH_AUTH_SOCK;
16:46:58  unset SSH_AGENT_PID;
16:46:58  echo Agent pid 5178 killed;
16:46:58  [ssh-agent] Stopped.
16:46:58  [PostBuildScript] - [INFO] Executing post build scripts.
16:46:58  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins2933177647309485218.sh
16:46:58  ---> sysstat.sh
16:46:59  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins15766070663502913600.sh
16:46:59  ---> package-listing.sh
16:46:59  ++ facter osfamily
16:46:59  ++ tr '[:upper:]' '[:lower:]'
16:46:59  + OS_FAMILY=redhat
16:46:59  + workspace=/w/workspace/ci-management-jenkins-cfg-verify
16:46:59  + START_PACKAGES=/tmp/packages_start.txt
16:46:59  + END_PACKAGES=/tmp/packages_end.txt
16:46:59  + DIFF_PACKAGES=/tmp/packages_diff.txt
16:46:59  + PACKAGES=/tmp/packages_start.txt
16:46:59  + '[' /w/workspace/ci-management-jenkins-cfg-verify ']'
16:46:59  + PACKAGES=/tmp/packages_end.txt
16:46:59  + case "${OS_FAMILY}" in
16:46:59  + rpm -qa
16:46:59  + sort
16:47:07  + '[' -f /tmp/packages_start.txt ']'
16:47:07  + '[' -f /tmp/packages_end.txt ']'
16:47:07  + diff /tmp/packages_start.txt /tmp/packages_end.txt
16:47:07  + '[' /w/workspace/ci-management-jenkins-cfg-verify ']'
16:47:07  + mkdir -p /w/workspace/ci-management-jenkins-cfg-verify/archives/
16:47:07  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-jenkins-cfg-verify/archives/
16:47:07  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins13977718301752112755.sh
16:47:07  ---> capture-instance-metadata.sh
16:47:07  Setup pyenv:
16:47:07    system
16:47:07    3.8.13
16:47:07    3.9.13
16:47:07  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:47:07  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8hUM from file:/tmp/.os_lf_venv
16:47:09  lf-activate-venv(): INFO: Installing: lftools 
16:47:18  lf-activate-venv(): INFO: Adding /tmp/venv-8hUM/bin to PATH
16:47:18  INFO: Running in OpenStack, capturing instance metadata
16:47:19  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins14590369347488541527.sh
16:47:19  provisioning config files...
16:47:19  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-jenkins-cfg-verify@tmp/config9801877002403745130tmp
16:47:20  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
16:47:20  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
16:47:20  [EnvInject] - Injecting environment variables from a build step.
16:47:20  [EnvInject] - Injecting as environment variables the properties content 
16:47:20  SERVER_ID=logs
16:47:20  
16:47:20  [EnvInject] - Variables injected successfully.
16:47:20  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins13112979204724026440.sh
16:47:20  ---> create-netrc.sh
16:47:20  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins11476823498278972813.sh
16:47:20  ---> python-tools-install.sh
16:47:20  Setup pyenv:
16:47:20    system
16:47:20    3.8.13
16:47:20    3.9.13
16:47:20  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:47:20  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8hUM from file:/tmp/.os_lf_venv
16:47:21  lf-activate-venv(): INFO: Installing: lftools 
16:47:31  lf-activate-venv(): INFO: Adding /tmp/venv-8hUM/bin to PATH
16:47:31  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins3673026170851464146.sh
16:47:31  ---> sudo-logs.sh
16:47:31  Archiving 'sudo' log..
16:47:31  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins11032362718383518512.sh
16:47:31  ---> job-cost.sh
16:47:31  Setup pyenv:
16:47:31    system
16:47:31    3.8.13
16:47:31    3.9.13
16:47:31  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:47:31  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8hUM from file:/tmp/.os_lf_venv
16:47:33  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
16:47:38  lf-activate-venv(): INFO: Adding /tmp/venv-8hUM/bin to PATH
16:47:38  INFO: No Stack...
16:47:39  INFO: Retrieving Pricing Info for: v2-highcpu-1
16:47:39  INFO: Archiving Costs
16:47:39  [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins8307061646056207915.sh
16:47:39  ---> logs-deploy.sh
16:47:39  Setup pyenv:
16:47:39    system
16:47:39    3.8.13
16:47:39    3.9.13
16:47:39  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:47:39  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-8hUM from file:/tmp/.os_lf_venv
16:47:40  lf-activate-venv(): INFO: Installing: lftools 
16:47:49  lf-activate-venv(): INFO: Adding /tmp/venv-8hUM/bin to PATH
16:47:49  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-jenkins-cfg-verify/218
16:47:49  INFO: archiving workspace using pattern(s): 
16:47:52  Archives upload complete.
16:47:52  INFO: archiving logs to Nexus
16:47:53  ---> uname -a:
16:47:53  Linux prd-centos8-builder-1c-1g-2811.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
16:47:53  
16:47:53  
16:47:53  ---> lscpu:
16:47:53  Architecture:        x86_64
16:47:53  CPU op-mode(s):      32-bit, 64-bit
16:47:53  Byte Order:          Little Endian
16:47:53  CPU(s):              1
16:47:53  On-line CPU(s) list: 0
16:47:53  Thread(s) per core:  1
16:47:53  Core(s) per socket:  1
16:47:53  Socket(s):           1
16:47:53  NUMA node(s):        1
16:47:53  Vendor ID:           AuthenticAMD
16:47:53  CPU family:          23
16:47:53  Model:               49
16:47:53  Model name:          AMD EPYC-Rome Processor
16:47:53  Stepping:            0
16:47:53  CPU MHz:             2799.998
16:47:53  BogoMIPS:            5599.99
16:47:53  Virtualization:      AMD-V
16:47:53  Hypervisor vendor:   KVM
16:47:53  Virtualization type: full
16:47:53  L1d cache:           32K
16:47:53  L1i cache:           32K
16:47:53  L2 cache:            512K
16:47:53  L3 cache:            16384K
16:47:53  NUMA node0 CPU(s):   0
16:47:53  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
16:47:53  
16:47:53  
16:47:53  ---> nproc:
16:47:53  1
16:47:53  
16:47:53  
16:47:53  ---> df -h:
16:47:53  Filesystem      Size  Used Avail Use% Mounted on
16:47:53  devtmpfs        329M     0  329M   0% /dev
16:47:53  tmpfs           386M     0  386M   0% /dev/shm
16:47:53  tmpfs           386M   11M  376M   3% /run
16:47:53  tmpfs           386M     0  386M   0% /sys/fs/cgroup
16:47:53  /dev/vda1        20G  9.0G   12G  45% /
16:47:53  tmpfs            78M     0   78M   0% /run/user/1001
16:47:53  
16:47:53  
16:47:53  ---> free -m:
16:47:53                total        used        free      shared  buff/cache   available
16:47:53  Mem:            770         328          50           5         391         311
16:47:53  Swap:          1023          29         994
16:47:53  
16:47:53  
16:47:53  ---> ip addr:
16:47:53  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
16:47:53      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
16:47:53      inet 127.0.0.1/8 scope host lo
16:47:53         valid_lft forever preferred_lft forever
16:47:53      inet6 ::1/128 scope host 
16:47:53         valid_lft forever preferred_lft forever
16:47:53  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
16:47:53      link/ether fa:16:3e:25:50:ac brd ff:ff:ff:ff:ff:ff
16:47:53      altname enp0s3
16:47:53      altname ens3
16:47:53      inet 10.32.7.90/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
16:47:53         valid_lft 86145sec preferred_lft 86145sec
16:47:53      inet6 fe80::f816:3eff:fe25:50ac/64 scope link 
16:47:53         valid_lft forever preferred_lft forever
16:47:53  
16:47:53  
16:47:53  ---> sar -b -r -n DEV:
16:47:53  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	06/06/2024 	_x86_64_	(1 CPU)
16:47:53  
16:47:53  16:43:32     LINUX RESTART	(1 CPU)
16:47:53  
16:47:53  04:44:01 PM       tps      rtps      wtps   bread/s   bwrtn/s
16:47:53  04:45:01 PM    205.36     85.47    119.89   8383.54  42412.91
16:47:53  04:46:01 PM    120.73     31.94     88.79   3218.13  10840.80
16:47:53  04:47:01 PM     50.97     34.79     16.18   3023.13   1141.70
16:47:53  Average:       125.69     50.74     74.95   4875.13  18133.15
16:47:53  
16:47:53  04:44:01 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
16:47:53  04:45:01 PM     79460    302928    709752     89.93      2100    298948    514676     28.01    137572    428368     37772
16:47:53  04:46:01 PM     90588    332840    698624     88.52       108    310252    475688     25.88    113228    417100     21924
16:47:53  04:47:01 PM     47408    353072    741804     93.99       108    373000    457136     24.87    122944    447304        36
16:47:53  Average:        72485    329613    716727     90.82       772    327400    482500     26.25    124581    430924     19911
16:47:53  
16:47:53  04:44:01 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
16:47:53  04:45:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:47:53  04:45:01 PM      eth0    222.04    129.80   1403.85     59.79      0.00      0.00      0.00      0.00
16:47:53  04:46:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:47:53  04:46:01 PM      eth0     39.20     35.79    310.24      5.70      0.00      0.00      0.00      0.00
16:47:53  04:47:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:47:53  04:47:01 PM      eth0     36.62     26.01     65.22      6.86      0.00      0.00      0.00      0.00
16:47:53  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:47:53  Average:         eth0     99.29     63.87    593.15     24.12      0.00      0.00      0.00      0.00
16:47:53  
16:47:53  
16:47:53  ---> sar -P ALL:
16:47:53  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	06/06/2024 	_x86_64_	(1 CPU)
16:47:53  
16:47:53  16:43:32     LINUX RESTART	(1 CPU)
16:47:53  
16:47:53  04:44:01 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:47:53  04:45:01 PM     all     49.94      0.07     13.47      9.94      0.12     26.46
16:47:53  04:45:01 PM       0     49.94      0.07     13.47      9.94      0.12     26.46
16:47:53  04:46:01 PM     all     59.58      0.00      8.99      3.06      0.10     28.27
16:47:53  04:46:01 PM       0     59.58      0.00      8.99      3.06      0.10     28.27
16:47:53  04:47:01 PM     all     35.48      0.00      4.06      3.99      0.07     56.40
16:47:53  04:47:01 PM       0     35.48      0.00      4.06      3.99      0.07     56.40
16:47:53  Average:        all     48.33      0.02      8.84      5.66      0.09     37.05
16:47:53  Average:          0     48.33      0.02      8.84      5.66      0.09     37.05
16:47:53  
16:47:53  
16:47:53