16:31:44  Retriggered by user jwagantall for Gerrit: https://gerrit.o-ran-sc.org/r/c/ci-management/+/12860
16:31:44  Running as SYSTEM
16:31:44  [EnvInject] - Loading node environment variables.
16:31:44  Building remotely on prd-centos8-builder-1c-1g-2808 (centos8-builder-1c-1g) in workspace /w/workspace/ci-management-jenkins-cfg-verify
16:31:44  [ssh-agent] Looking for ssh-agent implementation...
16:31:45  [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
16:31:45  $ ssh-agent
16:31:45  SSH_AUTH_SOCK=/tmp/ssh-MBQZXnrh0lKG/agent.5174
16:31:45  SSH_AGENT_PID=5176
16:31:45  [ssh-agent] Started.
16:31:45  Running ssh-add (command line suppressed)
16:31:45  Identity added: /w/workspace/ci-management-jenkins-cfg-verify@tmp/private_key_8015227518742634016.key (jenkins-ssh)
16:31:45  [ssh-agent] Using credentials jenkins (jenkins)
16:31:45  The recommended git tool is: NONE
16:31:49  using credential jenkins
16:31:49  Wiping out workspace first.
16:31:49  Cloning the remote Git repository
16:31:49  Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:31:49   > git init /w/workspace/ci-management-jenkins-cfg-verify # timeout=10
16:31:49  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:31:49   > git --version # timeout=10
16:31:49   > git --version # 'git version 2.43.0'
16:31:49  using GIT_SSH to set credentials jenkins
16:31:49  [INFO] Currently running in a labeled security context
16:31:49  [INFO] Currently SELinux is 'enforcing' on the host
16:31:49   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh8988751605203737165.key
16:31:49   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10
16:31:50   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:31:51   > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10
16:31:51   > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10
16:31:51  Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management
16:31:51  using GIT_SSH to set credentials jenkins
16:31:51  [INFO] Currently running in a labeled security context
16:31:51  [INFO] Currently SELinux is 'enforcing' on the host
16:31:51   > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-jenkins-cfg-verify@tmp/jenkins-gitclient-ssh2494160660662999293.key
16:31:51   > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management refs/changes/60/12860/1 # timeout=10
16:31:52   > git rev-parse 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3^{commit} # timeout=10
16:31:52  JENKINS-19022: warning: possible memory leak due to Git plugin usage; see: https://plugins.jenkins.io/git/#remove-git-plugin-buildsbybranch-builddata-script
16:31:52  Checking out Revision 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3 (refs/changes/60/12860/1)
16:31:52   > git config core.sparsecheckout # timeout=10
16:31:52   > git checkout -f 41bf5cb5809a2438c6977b7c2d19f0084e5a4dc3 # timeout=10
16:31:55  Commit message: "Chore: Automation adds smo/teiv config files"
16:31:55   > git rev-parse FETCH_HEAD^{commit} # timeout=10
16:31:55   > git rev-list --no-walk 745cb85f56bdb45eb2fab69bc09387de5cc0b572 # timeout=10
16:31:56   > git remote # timeout=10
16:31:56   > git submodule init # timeout=10
16:31:56   > git submodule sync # timeout=10
16:31:56   > git config --get remote.origin.url # timeout=10
16:31:56   > git submodule init # timeout=10
16:31:56   > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10
16:31:56   > git config --get submodule.packer/common-packer.url # timeout=10
16:31:56   > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10
16:31:56   > git config --get submodule.global-jjb.url # timeout=10
16:31:56   > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10
16:31:56   > git submodule update --init --recursive packer/common-packer # timeout=10
16:31:57   > git submodule update --init --recursive global-jjb # timeout=10
16:31:58  provisioning config files...
16:31:58  copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml
16:31:59  copy managed file [npmrc] to file:/home/jenkins/.npmrc
16:31:59  copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf
16:31:59  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins1627811410380221425.sh
16:31:59  ---> python-tools-install.sh
16:31:59  Setup pyenv:
16:31:59    system
16:31:59  * 3.8.13 (set by /opt/pyenv/version)
16:31:59  * 3.9.13 (set by /opt/pyenv/version)
16:31:59  * 3.10.6 (set by /opt/pyenv/version)
16:32:03  lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-tTex
16:32:03  lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv
16:32:07  lf-activate-venv(): INFO: Installing: lftools 
16:32:39  lf-activate-venv(): INFO: Adding /tmp/venv-tTex/bin to PATH
16:32:39  Generating Requirements File
16:33:04  Python 3.10.6
16:33:04  pip 24.0 from /tmp/venv-tTex/lib/python3.10/site-packages/pip (python 3.10)
16:33:04  appdirs==1.4.4
16:33:04  argcomplete==3.3.0
16:33:04  aspy.yaml==1.3.0
16:33:04  attrs==23.2.0
16:33:04  autopage==0.5.2
16:33:04  beautifulsoup4==4.12.3
16:33:04  boto3==1.34.120
16:33:04  botocore==1.34.120
16:33:04  bs4==0.0.2
16:33:04  cachetools==5.3.3
16:33:04  certifi==2024.6.2
16:33:04  cffi==1.16.0
16:33:04  cfgv==3.4.0
16:33:04  chardet==5.2.0
16:33:04  charset-normalizer==3.3.2
16:33:04  click==8.1.7
16:33:04  cliff==4.7.0
16:33:04  cmd2==2.4.3
16:33:04  cryptography==3.3.2
16:33:04  debtcollector==3.0.0
16:33:04  decorator==5.1.1
16:33:04  defusedxml==0.7.1
16:33:04  Deprecated==1.2.14
16:33:04  distlib==0.3.8
16:33:04  dnspython==2.6.1
16:33:04  docker==4.2.2
16:33:04  dogpile.cache==1.3.3
16:33:04  email_validator==2.1.1
16:33:04  filelock==3.14.0
16:33:04  future==1.0.0
16:33:04  gitdb==4.0.11
16:33:04  GitPython==3.1.43
16:33:04  google-auth==2.29.0
16:33:04  httplib2==0.22.0
16:33:04  identify==2.5.36
16:33:04  idna==3.7
16:33:04  importlib-resources==1.5.0
16:33:04  iso8601==2.1.0
16:33:04  Jinja2==3.1.4
16:33:04  jmespath==1.0.1
16:33:04  jsonpatch==1.33
16:33:04  jsonpointer==2.4
16:33:04  jsonschema==4.22.0
16:33:04  jsonschema-specifications==2023.12.1
16:33:04  keystoneauth1==5.6.0
16:33:04  kubernetes==29.0.0
16:33:04  lftools==0.37.10
16:33:04  lxml==5.2.2
16:33:04  MarkupSafe==2.1.5
16:33:04  msgpack==1.0.8
16:33:04  multi_key_dict==2.0.3
16:33:04  munch==4.0.0
16:33:04  netaddr==1.3.0
16:33:04  netifaces==0.11.0
16:33:04  niet==1.4.2
16:33:04  nodeenv==1.9.1
16:33:04  oauth2client==4.1.3
16:33:04  oauthlib==3.2.2
16:33:04  openstacksdk==3.1.0
16:33:04  os-client-config==2.1.0
16:33:04  os-service-types==1.7.0
16:33:04  osc-lib==3.0.1
16:33:04  oslo.config==9.4.0
16:33:04  oslo.context==5.5.0
16:33:04  oslo.i18n==6.3.0
16:33:04  oslo.log==6.0.0
16:33:04  oslo.serialization==5.4.0
16:33:04  oslo.utils==7.1.0
16:33:04  packaging==24.0
16:33:04  pbr==6.0.0
16:33:04  platformdirs==4.2.2
16:33:04  prettytable==3.10.0
16:33:04  pyasn1==0.6.0
16:33:04  pyasn1_modules==0.4.0
16:33:04  pycparser==2.22
16:33:04  pygerrit2==2.0.15
16:33:04  PyGithub==2.3.0
16:33:04  PyJWT==2.8.0
16:33:04  PyNaCl==1.5.0
16:33:04  pyparsing==2.4.7
16:33:04  pyperclip==1.8.2
16:33:04  pyrsistent==0.20.0
16:33:04  python-cinderclient==9.5.0
16:33:04  python-dateutil==2.9.0.post0
16:33:04  python-heatclient==3.5.0
16:33:04  python-jenkins==1.8.2
16:33:04  python-keystoneclient==5.4.0
16:33:04  python-magnumclient==4.5.0
16:33:04  python-novaclient==18.6.0
16:33:04  python-openstackclient==6.6.0
16:33:04  python-swiftclient==4.6.0
16:33:04  PyYAML==6.0.1
16:33:04  referencing==0.35.1
16:33:04  requests==2.32.3
16:33:04  requests-oauthlib==2.0.0
16:33:04  requestsexceptions==1.4.0
16:33:04  rfc3986==2.0.0
16:33:04  rpds-py==0.18.1
16:33:04  rsa==4.9
16:33:04  ruamel.yaml==0.18.6
16:33:04  ruamel.yaml.clib==0.2.8
16:33:04  s3transfer==0.10.1
16:33:04  simplejson==3.19.2
16:33:04  six==1.16.0
16:33:04  smmap==5.0.1
16:33:04  soupsieve==2.5
16:33:04  stevedore==5.2.0
16:33:04  tabulate==0.9.0
16:33:04  toml==0.10.2
16:33:04  tomlkit==0.12.5
16:33:04  tqdm==4.66.4
16:33:04  typing_extensions==4.12.1
16:33:04  tzdata==2024.1
16:33:04  urllib3==1.26.18
16:33:04  virtualenv==20.26.2
16:33:04  wcwidth==0.2.13
16:33:04  websocket-client==1.8.0
16:33:04  wrapt==1.16.0
16:33:04  xdg==6.0.0
16:33:04  xmltodict==0.13.0
16:33:04  yq==3.4.3
16:33:05  [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins7159576273355087316.sh
16:33:05  ---> jenkins-verify-images.sh
16:33:05  + source /home/jenkins/lf-env.sh
16:33:05  + '[' -f /tmp/.os_lf_venv ']'
16:33:05  ++ cat /tmp/.os_lf_venv
16:33:05  + os_lf_venv=/tmp/venv-tTex
16:33:05  + '[' -d /tmp/venv-tTex ']'
16:33:05  + '[' -f /tmp/venv-tTex/bin/openstack ']'
16:33:05  + echo 'Re-use existing venv: /tmp/venv-tTex'
16:33:05  Re-use existing venv: /tmp/venv-tTex
16:33:05  + PATH=/tmp/venv-tTex/bin:/home/jenkins/.local/bin:/home/jenkins/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/puppetlabs/bin
16:33:05  + error=false
16:33:05  + echo 'Verifying that cloud has a master configuration file'
16:33:05  Verifying that cloud has a master configuration file
16:33:05  + [[ -d jenkins-config/clouds/openstack ]]
16:33:05  + for cloud in jenkins-config/clouds/openstack/*
16:33:05  + [[ -f jenkins-config/clouds/openstack/cattle/cloud.cfg ]]
16:33:05  ++ grep -E '^OS_CLOUD=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:33:05  ++ cut -d= -f2
16:33:05  + os_cloud=
16:33:05  + os_cloud=vex
16:33:05  + OS_CLOUD=vex
16:33:05  + verify_images jenkins-config/clouds/openstack/cattle
16:33:05  + echo 'Verifying images on jenkins-config/clouds/openstack/cattle'
16:33:05  Verifying images on jenkins-config/clouds/openstack/cattle
16:33:05  + for file in "$1"/*
16:33:05  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg ']'
16:33:05  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg
16:33:05  + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:33:05  + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:33:05  + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228'
16:33:05  + grep active
16:33:09  | 4fab7a7c-385a-42b7-a11c-ffe686c5371c | ZZCI - CentOS 7 - builder - x86_64 - 20240201-210113.228 | active |
16:33:09  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-builder-1c-1g.cfg
16:33:09  + export HARDWARE_ID=v2-highcpu-1
16:33:09  + HARDWARE_ID=v2-highcpu-1
16:33:09  + openstack flavor list
16:33:09  + grep ' v2-highcpu-1 '
16:33:11  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:33:11  + for file in "$1"/*
16:33:11  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg ']'
16:33:11  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg
16:33:11  + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:11  + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:11  + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:11  + grep active
16:33:15  | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active |
16:33:15  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g-200g.cfg
16:33:15  + export HARDWARE_ID=v2-standard-2
16:33:15  + HARDWARE_ID=v2-standard-2
16:33:15  + openstack flavor list
16:33:15  + grep ' v2-standard-2 '
16:33:16  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:33:16  + for file in "$1"/*
16:33:16  + '[' -f jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg ']'
16:33:16  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg
16:33:16  + export 'IMAGE_NAME=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:16  + IMAGE_NAME='ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:16  + openstack image list --property 'name=ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713'
16:33:16  + grep active
16:33:20  | f8f5be2b-119e-460a-81c3-c0b10dd25c5f | ZZCI - CentOS 7 - docker - x86_64 - 20240207-020748.713 | active |
16:33:20  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos7-docker-2c-8g.cfg
16:33:20  + export HARDWARE_ID=v2-standard-2
16:33:20  + HARDWARE_ID=v2-standard-2
16:33:20  + openstack flavor list
16:33:20  + grep ' v2-standard-2 '
16:33:22  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:33:22  + for file in "$1"/*
16:33:22  + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg ']'
16:33:22  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg
16:33:22  + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:22  + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:22  + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:22  + grep active
16:33:25  | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active |
16:33:25  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-1c-1g.cfg
16:33:25  + export HARDWARE_ID=v2-highcpu-1
16:33:25  + HARDWARE_ID=v2-highcpu-1
16:33:25  + openstack flavor list
16:33:25  + grep ' v2-highcpu-1 '
16:33:27  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:33:27  + for file in "$1"/*
16:33:27  + '[' -f jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg ']'
16:33:27  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg
16:33:27  + export 'IMAGE_NAME=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:27  + IMAGE_NAME='ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:27  + openstack image list --property 'name=ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191'
16:33:27  + grep active
16:33:31  | b55d6504-d53f-4d4d-b0aa-82917f09b160 | ZZCI - CentOS Stream 8 - builder - x86_64 - 20240101-220121.191 | active |
16:33:31  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/centos8-builder-2c-2g.cfg
16:33:31  + export HARDWARE_ID=v2-standard-2
16:33:31  + HARDWARE_ID=v2-standard-2
16:33:31  + openstack flavor list
16:33:31  + grep ' v2-standard-2 '
16:33:33  | ac2c4d17-8d6f-4e3c-a9eb-57c155f0a949 | v2-standard-2  |   8192 |    0 |         0 |     2 | True      |
16:33:33  + for file in "$1"/*
16:33:33  + '[' -f jenkins-config/clouds/openstack/cattle/cloud.cfg ']'
16:33:33  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:33:33  + export 'IMAGE_NAME=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:33:33  + IMAGE_NAME='ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:33:33  + openstack image list --property 'name=ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874'
16:33:33  + grep active
16:33:36  | 343bd23c-ed30-4138-b918-89afcc7604b1 | ZZCI - CentOS 7 - builder - x86_64 - 20230501-210122.874 | active |
16:33:36  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/cloud.cfg
16:33:36  + export HARDWARE_ID=v2-highcpu-1
16:33:36  + HARDWARE_ID=v2-highcpu-1
16:33:36  + openstack flavor list
16:33:36  + grep ' v2-highcpu-1 '
16:33:38  | c04abb7a-2b61-4ed3-8ce8-6c40ad9df750 | v2-highcpu-1   |   1024 |    0 |         0 |     1 | True      |
16:33:38  + for file in "$1"/*
16:33:38  + '[' -f jenkins-config/clouds/openstack/cattle/releasenotes ']'
16:33:38  + for file in "$1"/*
16:33:38  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg ']'
16:33:38  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg
16:33:38  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:33:38  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:33:38  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546'
16:33:38  + grep active
16:33:42  | 5f051f05-de78-4696-a031-19f161e114c2 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20240101-050208.546 | active |
16:33:42  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-2c-2g.cfg
16:33:42  + export HARDWARE_ID=v2-highcpu-2
16:33:42  + HARDWARE_ID=v2-highcpu-2
16:33:42  + grep ' v2-highcpu-2 '
16:33:42  + openstack flavor list
16:33:43  | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2   |   2048 |    0 |         0 |     2 | True      |
16:33:43  + for file in "$1"/*
16:33:43  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg ']'
16:33:43  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg
16:33:43  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:33:43  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:33:43  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749'
16:33:43  + grep active
16:33:47  | df2201fe-3e7f-4b7a-9efe-dc672337afb0 | ZZCI - Ubuntu 18.04 - builder - x86_64 - 20220920-114402.749 | active |
16:33:47  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-builder-4c-4g.cfg
16:33:47  + export HARDWARE_ID=v2-highcpu-4
16:33:47  + HARDWARE_ID=v2-highcpu-4
16:33:47  + openstack flavor list
16:33:47  + grep ' v2-highcpu-4 '
16:33:49  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:33:49  + for file in "$1"/*
16:33:49  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg ']'
16:33:49  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg
16:33:49  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:49  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:49  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:49  + grep active
16:33:52  | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active |
16:33:52  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-2c-8g.cfg
16:33:52  + export HARDWARE_ID=v2-highcpu-4
16:33:52  + HARDWARE_ID=v2-highcpu-4
16:33:52  + openstack flavor list
16:33:52  + grep ' v2-highcpu-4 '
16:33:54  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:33:54  + for file in "$1"/*
16:33:54  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg ']'
16:33:54  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg
16:33:54  + export 'IMAGE_NAME=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:54  + IMAGE_NAME='ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:54  + openstack image list --property 'name=ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956'
16:33:54  + grep active
16:33:57  | 363324d0-d934-4397-a96c-67f60045cedd | ZZCI - Ubuntu 18.04 - docker - x86_64 - 20240207-020748.956 | active |
16:33:57  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu1804-docker-4c-4g.cfg
16:33:57  + export HARDWARE_ID=v2-highcpu-4
16:33:57  + HARDWARE_ID=v2-highcpu-4
16:33:57  + openstack flavor list
16:33:57  + grep ' v2-highcpu-4 '
16:33:59  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:33:59  + for file in "$1"/*
16:33:59  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg ']'
16:33:59  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg
16:33:59  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:33:59  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:33:59  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:33:59  + grep active
16:34:03  | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active |
16:34:03  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-2c-2g.cfg
16:34:03  + export HARDWARE_ID=v2-highcpu-2
16:34:03  + HARDWARE_ID=v2-highcpu-2
16:34:03  + grep ' v2-highcpu-2 '
16:34:03  + openstack flavor list
16:34:04  | 03bdf34e-8905-46bc-a4b9-8dbf94b6e06d | v2-highcpu-2   |   2048 |    0 |         0 |     2 | True      |
16:34:04  + for file in "$1"/*
16:34:04  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg ']'
16:34:04  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg
16:34:04  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:34:04  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:34:04  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263'
16:34:04  + grep active
16:34:08  | f515d236-25ce-4fb1-98d8-9043a9f9b0b6 | ZZCI - Ubuntu 20.04 - builder - x86_64 - 20240101-020156.263 | active |
16:34:08  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-builder-4c-4g.cfg
16:34:08  + export HARDWARE_ID=v2-highcpu-4
16:34:08  + HARDWARE_ID=v2-highcpu-4
16:34:08  + openstack flavor list
16:34:08  + grep ' v2-highcpu-4 '
16:34:10  | 3b72e578-7875-4e0e-91b7-71ed292f3ca2 | v2-highcpu-4   |   4096 |    0 |         0 |     4 | True      |
16:34:10  + for file in "$1"/*
16:34:10  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg ']'
16:34:10  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg
16:34:10  + export 'IMAGE_NAME=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:34:10  + IMAGE_NAME='ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:34:10  + openstack image list --property 'name=ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255'
16:34:10  + grep active
16:34:13  | c962a012-598c-4b9f-a5a0-a5e2cfbaba77 | ZZCI - Ubuntu 20.04 - devstack - x86_64 - 20230913-095841.255 | active |
16:34:13  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2004-devstack-4c-16g.cfg
16:34:13  + export HARDWARE_ID=v3-standard-4
16:34:13  + HARDWARE_ID=v3-standard-4
16:34:13  + openstack flavor list
16:34:13  + grep ' v3-standard-4 '
16:34:15  | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4  |  16384 |   80 |         0 |     4 | True      |
16:34:15  + for file in "$1"/*
16:34:15  + '[' -f jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg ']'
16:34:15  ++ grep '^IMAGE_NAME=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg
16:34:15  + export 'IMAGE_NAME=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:34:15  + IMAGE_NAME='ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:34:15  + openstack image list --property 'name=ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118'
16:34:15  + grep active
16:34:18  | a6f6b7c5-9e94-4781-8f55-24b20e6a598f | ZZCI - Ubuntu 22.04 - devstack - x86_64 - 20231031-095146.118 | active |
16:34:18  ++ grep '^HARDWARE_ID=' jenkins-config/clouds/openstack/cattle/ubuntu2204-devstack-4c-16g.cfg
16:34:18  + export HARDWARE_ID=v3-standard-4
16:34:18  + HARDWARE_ID=v3-standard-4
16:34:18  + openstack flavor list
16:34:18  + grep ' v3-standard-4 '
16:34:20  | 2aff8c4a-fb90-41e1-a1df-e010e325b88d | v3-standard-4  |  16384 |   80 |         0 |     4 | True      |
16:34:20  + false
16:34:21  $ ssh-agent -k
16:34:21  unset SSH_AUTH_SOCK;
16:34:21  unset SSH_AGENT_PID;
16:34:21  echo Agent pid 5176 killed;
16:34:21  [ssh-agent] Stopped.
16:34:21  [PostBuildScript] - [INFO] Executing post build scripts.
16:34:21  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins571047553021865345.sh
16:34:21  ---> sysstat.sh
16:34:22  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins2373525226290805805.sh
16:34:22  ---> package-listing.sh
16:34:22  ++ facter osfamily
16:34:22  ++ tr '[:upper:]' '[:lower:]'
16:34:22  + OS_FAMILY=redhat
16:34:22  + workspace=/w/workspace/ci-management-jenkins-cfg-verify
16:34:22  + START_PACKAGES=/tmp/packages_start.txt
16:34:22  + END_PACKAGES=/tmp/packages_end.txt
16:34:22  + DIFF_PACKAGES=/tmp/packages_diff.txt
16:34:22  + PACKAGES=/tmp/packages_start.txt
16:34:22  + '[' /w/workspace/ci-management-jenkins-cfg-verify ']'
16:34:22  + PACKAGES=/tmp/packages_end.txt
16:34:22  + case "${OS_FAMILY}" in
16:34:22  + rpm -qa
16:34:22  + sort
16:34:29  + '[' -f /tmp/packages_start.txt ']'
16:34:29  + '[' -f /tmp/packages_end.txt ']'
16:34:29  + diff /tmp/packages_start.txt /tmp/packages_end.txt
16:34:29  + '[' /w/workspace/ci-management-jenkins-cfg-verify ']'
16:34:29  + mkdir -p /w/workspace/ci-management-jenkins-cfg-verify/archives/
16:34:29  + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-jenkins-cfg-verify/archives/
16:34:29  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins4581277501862336251.sh
16:34:29  ---> capture-instance-metadata.sh
16:34:30  Setup pyenv:
16:34:30    system
16:34:30    3.8.13
16:34:30    3.9.13
16:34:30  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:34:30  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-tTex from file:/tmp/.os_lf_venv
16:34:31  lf-activate-venv(): INFO: Installing: lftools 
16:34:43  lf-activate-venv(): INFO: Adding /tmp/venv-tTex/bin to PATH
16:34:43  INFO: Running in OpenStack, capturing instance metadata
16:34:44  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins12303361395261943375.sh
16:34:44  provisioning config files...
16:34:44  copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-jenkins-cfg-verify@tmp/config4881164837451342897tmp
16:34:44  Regular expression run condition: Expression=[^.*logs-s3.*], Label=[]
16:34:44  Run condition [Regular expression match] preventing perform for step [Provide Configuration files]
16:34:44  [EnvInject] - Injecting environment variables from a build step.
16:34:44  [EnvInject] - Injecting as environment variables the properties content 
16:34:44  SERVER_ID=logs
16:34:44  
16:34:44  [EnvInject] - Variables injected successfully.
16:34:44  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins4818018093930572364.sh
16:34:44  ---> create-netrc.sh
16:34:44  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins14896404490451038481.sh
16:34:44  ---> python-tools-install.sh
16:34:44  Setup pyenv:
16:34:44    system
16:34:44    3.8.13
16:34:44    3.9.13
16:34:45  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:34:45  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-tTex from file:/tmp/.os_lf_venv
16:34:46  lf-activate-venv(): INFO: Installing: lftools 
16:34:55  lf-activate-venv(): INFO: Adding /tmp/venv-tTex/bin to PATH
16:34:55  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins10686034089169699964.sh
16:34:55  ---> sudo-logs.sh
16:34:55  Archiving 'sudo' log..
16:34:55  [ci-management-jenkins-cfg-verify] $ /bin/bash /tmp/jenkins7563902250736262506.sh
16:34:55  ---> job-cost.sh
16:34:55  Setup pyenv:
16:34:55    system
16:34:55    3.8.13
16:34:55    3.9.13
16:34:55  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:34:55  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-tTex from file:/tmp/.os_lf_venv
16:34:57  lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 
16:35:01  lf-activate-venv(): INFO: Adding /tmp/venv-tTex/bin to PATH
16:35:01  INFO: No Stack...
16:35:02  INFO: Retrieving Pricing Info for: v2-highcpu-1
16:35:02  INFO: Archiving Costs
16:35:02  [ci-management-jenkins-cfg-verify] $ /bin/bash -l /tmp/jenkins9898943698351781025.sh
16:35:02  ---> logs-deploy.sh
16:35:02  Setup pyenv:
16:35:02    system
16:35:02    3.8.13
16:35:02    3.9.13
16:35:02  * 3.10.6 (set by /w/workspace/ci-management-jenkins-cfg-verify/.python-version)
16:35:02  lf-activate-venv(): INFO: Reuse venv:/tmp/venv-tTex from file:/tmp/.os_lf_venv
16:35:04  lf-activate-venv(): INFO: Installing: lftools 
16:35:12  lf-activate-venv(): INFO: Adding /tmp/venv-tTex/bin to PATH
16:35:12  INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-jenkins-cfg-verify/216
16:35:12  INFO: archiving workspace using pattern(s): 
16:35:15  Archives upload complete.
16:35:15  INFO: archiving logs to Nexus
16:35:16  ---> uname -a:
16:35:16  Linux prd-centos8-builder-1c-1g-2808.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
16:35:16  
16:35:16  
16:35:16  ---> lscpu:
16:35:16  Architecture:        x86_64
16:35:16  CPU op-mode(s):      32-bit, 64-bit
16:35:16  Byte Order:          Little Endian
16:35:16  CPU(s):              1
16:35:16  On-line CPU(s) list: 0
16:35:16  Thread(s) per core:  1
16:35:16  Core(s) per socket:  1
16:35:16  Socket(s):           1
16:35:16  NUMA node(s):        1
16:35:16  Vendor ID:           AuthenticAMD
16:35:16  CPU family:          23
16:35:16  Model:               49
16:35:16  Model name:          AMD EPYC-Rome Processor
16:35:16  Stepping:            0
16:35:16  CPU MHz:             2799.998
16:35:16  BogoMIPS:            5599.99
16:35:16  Virtualization:      AMD-V
16:35:16  Hypervisor vendor:   KVM
16:35:16  Virtualization type: full
16:35:16  L1d cache:           32K
16:35:16  L1i cache:           32K
16:35:16  L2 cache:            512K
16:35:16  L3 cache:            16384K
16:35:16  NUMA node0 CPU(s):   0
16:35:16  Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities
16:35:16  
16:35:16  
16:35:16  ---> nproc:
16:35:16  1
16:35:16  
16:35:16  
16:35:16  ---> df -h:
16:35:16  Filesystem      Size  Used Avail Use% Mounted on
16:35:16  devtmpfs        329M     0  329M   0% /dev
16:35:16  tmpfs           386M     0  386M   0% /dev/shm
16:35:16  tmpfs           386M   11M  376M   3% /run
16:35:16  tmpfs           386M     0  386M   0% /sys/fs/cgroup
16:35:16  /dev/vda1        20G  9.0G   12G  45% /
16:35:16  tmpfs            78M     0   78M   0% /run/user/1001
16:35:16  
16:35:16  
16:35:16  ---> free -m:
16:35:16                total        used        free      shared  buff/cache   available
16:35:16  Mem:            770         313          55           6         401         324
16:35:16  Swap:          1023          21        1002
16:35:16  
16:35:16  
16:35:16  ---> ip addr:
16:35:16  1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
16:35:16      link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
16:35:16      inet 127.0.0.1/8 scope host lo
16:35:16         valid_lft forever preferred_lft forever
16:35:16      inet6 ::1/128 scope host 
16:35:16         valid_lft forever preferred_lft forever
16:35:16  2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1450 qdisc fq_codel state UP group default qlen 1000
16:35:16      link/ether fa:16:3e:31:6a:d5 brd ff:ff:ff:ff:ff:ff
16:35:16      altname enp0s3
16:35:16      altname ens3
16:35:16      inet 10.32.6.198/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0
16:35:16         valid_lft 86151sec preferred_lft 86151sec
16:35:16      inet6 fe80::f816:3eff:fe31:6ad5/64 scope link 
16:35:16         valid_lft forever preferred_lft forever
16:35:16  
16:35:16  
16:35:16  ---> sar -b -r -n DEV:
16:35:16  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	06/06/2024 	_x86_64_	(1 CPU)
16:35:16  
16:35:16  16:31:01     LINUX RESTART	(1 CPU)
16:35:16  
16:35:16  04:32:02 PM       tps      rtps      wtps   bread/s   bwrtn/s
16:35:16  04:33:01 PM    159.50     22.34    137.16   3075.61  14853.01
16:35:16  04:34:01 PM     29.60     16.09     13.51    990.57   1492.14
16:35:16  04:35:01 PM    129.40    107.38     22.03   7889.31    885.95
16:35:16  Average:       105.88     48.76     57.12   3990.84   5692.54
16:35:16  
16:35:16  04:32:02 PM kbmemfree   kbavail kbmemused  %memused kbbuffers  kbcached  kbcommit   %commit  kbactive   kbinact   kbdirty
16:35:16  04:33:01 PM     70312    309016    718900     91.09      1072    306372    521212     28.36    111996    443408     15676
16:35:16  04:34:01 PM     84192    348168    705020     89.33       956    329956    474208     25.80    129912    403360        12
16:35:16  04:35:01 PM    153476    405152    635736     80.55       360    317512    469740     25.56    126968    340360     13288
16:35:16  Average:       102660    354112    686552     86.99       796    317947    488387     26.57    122959    395709      9659
16:35:16  
16:35:16  04:32:02 PM     IFACE   rxpck/s   txpck/s    rxkB/s    txkB/s   rxcmp/s   txcmp/s  rxmcst/s   %ifutil
16:35:16  04:33:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:35:16  04:33:01 PM      eth0     77.66     73.87    925.90      8.63      0.00      0.00      0.00      0.00
16:35:16  04:34:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:35:16  04:34:01 PM      eth0     33.98     24.44     62.05      4.36      0.00      0.00      0.00      0.00
16:35:16  04:35:01 PM        lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:35:16  04:35:01 PM      eth0     25.72     22.01     34.08     12.11      0.00      0.00      0.00      0.00
16:35:16  Average:           lo      0.00      0.00      0.00      0.00      0.00      0.00      0.00      0.00
16:35:16  Average:         eth0     45.61     39.92    337.39      8.36      0.00      0.00      0.00      0.00
16:35:16  
16:35:16  
16:35:16  ---> sar -P ALL:
16:35:16  Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 	06/06/2024 	_x86_64_	(1 CPU)
16:35:16  
16:35:16  16:31:01     LINUX RESTART	(1 CPU)
16:35:16  
16:35:16  04:32:02 PM     CPU     %user     %nice   %system   %iowait    %steal     %idle
16:35:16  04:33:01 PM     all     70.55      0.00     10.69      4.43      0.10     14.23
16:35:16  04:33:01 PM       0     70.55      0.00     10.69      4.43      0.10     14.23
16:35:16  04:34:01 PM     all     37.66      0.00      4.39      1.57      0.08     56.29
16:35:16  04:34:01 PM       0     37.66      0.00      4.39      1.57      0.08     56.29
16:35:16  04:35:01 PM     all     52.60      0.00      5.44     12.41      0.08     29.47
16:35:16  04:35:01 PM       0     52.60      0.00      5.44     12.41      0.08     29.47
16:35:16  Average:        all     53.51      0.00      6.82      6.15      0.09     33.43
16:35:16  Average:          0     53.51      0.00      6.82      6.15      0.09     33.43
16:35:16  
16:35:16  
16:35:16