19:04:48 Started by timer 19:04:48 Running as SYSTEM 19:04:48 [EnvInject] - Loading node environment variables. 19:04:48 Building remotely on prd-centos8-builder-1c-1g-4399 (centos8-builder-1c-1g) in workspace /w/workspace/ci-management-openstack-cron 19:04:48 [ssh-agent] Looking for ssh-agent implementation... 19:04:49 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 19:04:49 $ ssh-agent 19:04:49 SSH_AUTH_SOCK=/tmp/ssh-slxwnPl22owW/agent.5165 19:04:49 SSH_AGENT_PID=5166 19:04:49 [ssh-agent] Started. 19:04:49 Running ssh-add (command line suppressed) 19:04:49 Identity added: /w/workspace/ci-management-openstack-cron@tmp/private_key_7191590486688253990.key (jenkins-ssh) 19:04:49 [ssh-agent] Using credentials jenkins (jenkins) 19:04:49 The recommended git tool is: NONE 19:04:55 using credential jenkins 19:04:55 Wiping out workspace first. 19:04:55 Cloning the remote Git repository 19:04:55 Cloning repository ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 19:04:55 > git init /w/workspace/ci-management-openstack-cron # timeout=10 19:04:55 Fetching upstream changes from ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management 19:04:55 > git --version # timeout=10 19:04:55 > git --version # 'git version 2.43.0' 19:04:55 using GIT_SSH to set credentials jenkins 19:04:55 [INFO] Currently running in a labeled security context 19:04:55 [INFO] Currently SELinux is 'enforcing' on the host 19:04:55 > /usr/bin/chcon --type=ssh_home_t /w/workspace/ci-management-openstack-cron@tmp/jenkins-gitclient-ssh3079289475269409017.key 19:04:55 > git fetch --tags --force --progress -- ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management +refs/heads/*:refs/remotes/origin/* # timeout=10 19:04:57 > git config remote.origin.url ssh://oran-jobbuilder@gerrit.o-ran-sc.org:29418/ci-management # timeout=10 19:04:57 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 19:04:58 Avoid second fetch 19:04:58 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 19:04:58 Checking out Revision d058a26d7a3f4969071d065f50eb1f75fe4b469d (refs/remotes/origin/master) 19:04:58 > git config core.sparsecheckout # timeout=10 19:04:58 > git checkout -f d058a26d7a3f4969071d065f50eb1f75fe4b469d # timeout=10 19:04:59 Commit message: "Merge "NONRTRIC Tidy up docker jobs for unreleaseable images"" 19:04:59 > git rev-list --no-walk d058a26d7a3f4969071d065f50eb1f75fe4b469d # timeout=10 19:04:59 > git remote # timeout=10 19:04:59 > git submodule init # timeout=10 19:05:00 > git submodule sync # timeout=10 19:05:00 > git config --get remote.origin.url # timeout=10 19:05:00 > git submodule init # timeout=10 19:05:00 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 19:05:00 > git config --get submodule.packer/common-packer.url # timeout=10 19:05:00 > git config -f .gitmodules --get submodule.packer/common-packer.path # timeout=10 19:05:00 > git config --get submodule.global-jjb.url # timeout=10 19:05:00 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 19:05:00 > git submodule update --init --recursive packer/common-packer # timeout=10 19:05:01 > git submodule update --init --recursive global-jjb # timeout=10 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [Execute shell] 19:05:03 Run condition [Boolean condition] enabling prebuild for step [BuilderChain] 19:05:03 provisioning config files... 19:05:03 copy managed file [clouds-yaml] to file:/home/jenkins/.config/openstack/clouds.yaml 19:05:03 copy managed file [npmrc] to file:/home/jenkins/.npmrc 19:05:03 copy managed file [pipconf] to file:/home/jenkins/.config/pip/pip.conf 19:05:03 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins4274896866358016941.sh 19:05:03 ---> python-tools-install.sh 19:05:03 Setup pyenv: 19:05:03 system 19:05:04 * 3.8.13 (set by /opt/pyenv/version) 19:05:04 * 3.9.13 (set by /opt/pyenv/version) 19:05:04 * 3.10.6 (set by /opt/pyenv/version) 19:05:12 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-vDQR 19:05:12 lf-activate-venv(): INFO: Save venv in file: /tmp/.os_lf_venv 19:05:18 lf-activate-venv(): INFO: Installing: lftools 19:06:14 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:06:14 Generating Requirements File 19:07:04 Python 3.10.6 19:07:05 pip 24.0 from /tmp/venv-vDQR/lib/python3.10/site-packages/pip (python 3.10) 19:07:06 appdirs==1.4.4 19:07:06 argcomplete==3.2.3 19:07:06 aspy.yaml==1.3.0 19:07:06 attrs==23.2.0 19:07:06 autopage==0.5.2 19:07:06 beautifulsoup4==4.12.3 19:07:06 boto3==1.34.60 19:07:06 botocore==1.34.60 19:07:06 bs4==0.0.2 19:07:06 cachetools==5.3.3 19:07:06 certifi==2024.2.2 19:07:06 cffi==1.16.0 19:07:06 cfgv==3.4.0 19:07:06 chardet==5.2.0 19:07:06 charset-normalizer==3.3.2 19:07:06 click==8.1.7 19:07:06 cliff==4.6.0 19:07:06 cmd2==2.4.3 19:07:06 cryptography==3.3.2 19:07:06 debtcollector==3.0.0 19:07:06 decorator==5.1.1 19:07:06 defusedxml==0.7.1 19:07:06 Deprecated==1.2.14 19:07:06 distlib==0.3.8 19:07:06 dnspython==2.6.1 19:07:06 docker==4.2.2 19:07:06 dogpile.cache==1.3.2 19:07:06 email_validator==2.1.1 19:07:06 filelock==3.13.1 19:07:06 future==1.0.0 19:07:06 gitdb==4.0.11 19:07:06 GitPython==3.1.42 19:07:06 google-auth==2.28.2 19:07:06 httplib2==0.22.0 19:07:06 identify==2.5.35 19:07:06 idna==3.6 19:07:06 importlib-resources==1.5.0 19:07:06 iso8601==2.1.0 19:07:06 Jinja2==3.1.3 19:07:06 jmespath==1.0.1 19:07:06 jsonpatch==1.33 19:07:06 jsonpointer==2.4 19:07:06 jsonschema==4.21.1 19:07:06 jsonschema-specifications==2023.12.1 19:07:06 keystoneauth1==5.6.0 19:07:06 kubernetes==29.0.0 19:07:06 lftools==0.37.9 19:07:06 lxml==5.1.0 19:07:06 MarkupSafe==2.1.5 19:07:06 msgpack==1.0.8 19:07:06 multi_key_dict==2.0.3 19:07:06 netaddr==1.2.1 19:07:06 netifaces==0.11.0 19:07:06 niet==1.4.2 19:07:06 nodeenv==1.8.0 19:07:06 oauth2client==4.1.3 19:07:06 oauthlib==3.2.2 19:07:06 openstacksdk==3.0.0 19:07:06 os-client-config==2.1.0 19:07:06 os-service-types==1.7.0 19:07:06 osc-lib==3.0.1 19:07:06 oslo.config==9.4.0 19:07:06 oslo.context==5.5.0 19:07:06 oslo.i18n==6.3.0 19:07:06 oslo.log==5.5.0 19:07:06 oslo.serialization==5.4.0 19:07:06 oslo.utils==7.1.0 19:07:06 packaging==24.0 19:07:06 pbr==6.0.0 19:07:06 platformdirs==4.2.0 19:07:06 prettytable==3.10.0 19:07:06 pyasn1==0.5.1 19:07:06 pyasn1-modules==0.3.0 19:07:06 pycparser==2.21 19:07:06 pygerrit2==2.0.15 19:07:06 PyGithub==2.2.0 19:07:06 pyinotify==0.9.6 19:07:06 PyJWT==2.8.0 19:07:06 PyNaCl==1.5.0 19:07:06 pyparsing==2.4.7 19:07:06 pyperclip==1.8.2 19:07:06 pyrsistent==0.20.0 19:07:06 python-cinderclient==9.5.0 19:07:06 python-dateutil==2.9.0.post0 19:07:06 python-heatclient==3.5.0 19:07:06 python-jenkins==1.8.2 19:07:06 python-keystoneclient==5.4.0 19:07:06 python-magnumclient==4.4.0 19:07:06 python-novaclient==18.5.0 19:07:06 python-openstackclient==6.5.0 19:07:06 python-swiftclient==4.5.0 19:07:06 PyYAML==6.0.1 19:07:06 referencing==0.33.0 19:07:06 requests==2.31.0 19:07:06 requests-oauthlib==1.4.0 19:07:06 requestsexceptions==1.4.0 19:07:06 rfc3986==2.0.0 19:07:06 rpds-py==0.18.0 19:07:06 rsa==4.9 19:07:06 ruamel.yaml==0.18.6 19:07:06 ruamel.yaml.clib==0.2.8 19:07:06 s3transfer==0.10.0 19:07:06 simplejson==3.19.2 19:07:06 six==1.16.0 19:07:06 smmap==5.0.1 19:07:06 soupsieve==2.5 19:07:06 stevedore==5.2.0 19:07:06 tabulate==0.9.0 19:07:06 toml==0.10.2 19:07:06 tomlkit==0.12.4 19:07:06 tqdm==4.66.2 19:07:06 typing_extensions==4.10.0 19:07:06 tzdata==2024.1 19:07:06 urllib3==1.26.18 19:07:06 virtualenv==20.25.1 19:07:06 wcwidth==0.2.13 19:07:06 websocket-client==1.7.0 19:07:06 wrapt==1.16.0 19:07:06 xdg==6.0.0 19:07:06 xmltodict==0.13.0 19:07:06 yq==3.2.3 19:07:06 [EnvInject] - Injecting environment variables from a build step. 19:07:06 [EnvInject] - Injecting as environment variables the properties content 19:07:06 OS_CLOUD=vex 19:07:06 19:07:06 [EnvInject] - Variables injected successfully. 19:07:06 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:07:06 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:07:06 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3896558265136927229.sh 19:07:06 ---> Orphaned k8s clusters 19:07:06 Setup pyenv: 19:07:06 system 19:07:06 3.8.13 19:07:06 3.9.13 19:07:06 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:07:07 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:07:09 lf-activate-venv(): INFO: Installing: kubernetes python-heatclient python-openstackclient python-magnumclient 19:07:21 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. 19:07:21 botocore 1.34.60 requires urllib3<2.1,>=1.25.4; python_version >= "3.10", but you have urllib3 2.2.1 which is incompatible. 19:07:21 lftools 0.37.9 requires urllib3<2.0.0, but you have urllib3 2.2.1 which is incompatible. 19:07:21 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:07:26 -----> Delete orphaned cluster 19:07:26 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:07:26 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:07:26 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8450738947898437663.sh 19:07:27 ---> Orphaned stacks 19:07:27 Setup pyenv: 19:07:27 system 19:07:27 3.8.13 19:07:27 3.9.13 19:07:27 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:07:27 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:07:29 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 19:07:56 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:07:56 + mapfile -t OS_COE_CLUSTERS_ID 19:07:56 ++ awk '{print $1}' 19:07:56 ++ grep -E '(DELETE_FAILED|UNKNOWN|UNHEALTHY)' 19:07:56 ++ openstack --os-cloud vex coe cluster list -f value -c uuid -c name 19:07:58 Could not load 'address_scope_create': No module named 'munch' 19:07:58 Could not load 'address_scope_delete': No module named 'munch' 19:07:58 Could not load 'address_scope_list': No module named 'munch' 19:07:58 Could not load 'address_scope_set': No module named 'munch' 19:07:58 Could not load 'address_scope_show': No module named 'munch' 19:07:58 Could not load 'floating_ip_create': No module named 'munch' 19:07:58 Could not load 'floating_ip_delete': No module named 'munch' 19:07:58 Could not load 'floating_ip_list': No module named 'munch' 19:07:58 Could not load 'floating_ip_port_forwarding_create': No module named 'munch' 19:07:58 Could not load 'floating_ip_port_forwarding_delete': No module named 'munch' 19:07:58 Could not load 'floating_ip_port_forwarding_list': No module named 'munch' 19:07:58 Could not load 'floating_ip_port_forwarding_set': No module named 'munch' 19:07:58 Could not load 'floating_ip_port_forwarding_show': No module named 'munch' 19:07:58 Could not load 'floating_ip_set': No module named 'munch' 19:07:58 Could not load 'floating_ip_show': No module named 'munch' 19:07:58 Could not load 'floating_ip_unset': No module named 'munch' 19:07:58 Could not load 'ip_availability_list': No module named 'munch' 19:07:58 Could not load 'ip_availability_show': No module named 'munch' 19:07:58 Could not load 'network_agent_add_network': No module named 'munch' 19:07:58 Could not load 'network_agent_add_router': No module named 'munch' 19:07:58 Could not load 'network_agent_delete': No module named 'munch' 19:07:58 Could not load 'network_agent_list': No module named 'munch' 19:07:58 Could not load 'network_agent_remove_network': No module named 'munch' 19:07:58 Could not load 'network_agent_remove_router': No module named 'munch' 19:07:58 Could not load 'network_agent_set': No module named 'munch' 19:07:58 Could not load 'network_agent_show': No module named 'munch' 19:07:58 Could not load 'network_auto_allocated_topology_create': No module named 'munch' 19:07:58 Could not load 'network_auto_allocated_topology_delete': No module named 'munch' 19:07:58 Could not load 'network_create': No module named 'munch' 19:07:58 Could not load 'network_delete': No module named 'munch' 19:07:58 Could not load 'network_flavor_add_profile': No module named 'munch' 19:07:58 Could not load 'network_flavor_create': No module named 'munch' 19:07:58 Could not load 'network_flavor_delete': No module named 'munch' 19:07:58 Could not load 'network_flavor_list': No module named 'munch' 19:07:58 Could not load 'network_flavor_profile_create': No module named 'munch' 19:07:58 Could not load 'network_flavor_profile_delete': No module named 'munch' 19:07:58 Could not load 'network_flavor_profile_list': No module named 'munch' 19:07:58 Could not load 'network_flavor_profile_set': No module named 'munch' 19:07:58 Could not load 'network_flavor_profile_show': No module named 'munch' 19:07:58 Could not load 'network_flavor_remove_profile': No module named 'munch' 19:07:58 Could not load 'network_flavor_set': No module named 'munch' 19:07:58 Could not load 'network_flavor_show': No module named 'munch' 19:07:58 Could not load 'network_list': No module named 'munch' 19:07:58 Could not load 'network_meter_create': No module named 'munch' 19:07:58 Could not load 'network_meter_delete': No module named 'munch' 19:07:58 Could not load 'network_meter_list': No module named 'munch' 19:07:58 Could not load 'network_meter_rule_create': No module named 'munch' 19:07:58 Could not load 'network_meter_rule_delete': No module named 'munch' 19:07:58 Could not load 'network_meter_rule_list': No module named 'munch' 19:07:58 Could not load 'network_meter_rule_show': No module named 'munch' 19:07:58 Could not load 'network_meter_show': No module named 'munch' 19:07:58 Could not load 'network_qos_policy_create': No module named 'munch' 19:07:58 Could not load 'network_qos_policy_delete': No module named 'munch' 19:07:58 Could not load 'network_qos_policy_list': No module named 'munch' 19:07:58 Could not load 'network_qos_policy_set': No module named 'munch' 19:07:58 Could not load 'network_qos_policy_show': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_create': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_delete': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_list': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_set': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_show': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_type_list': No module named 'munch' 19:07:58 Could not load 'network_qos_rule_type_show': No module named 'munch' 19:07:58 Could not load 'network_rbac_create': No module named 'munch' 19:07:58 Could not load 'network_rbac_delete': No module named 'munch' 19:07:58 Could not load 'network_rbac_list': No module named 'munch' 19:07:58 Could not load 'network_rbac_set': No module named 'munch' 19:07:58 Could not load 'network_rbac_show': No module named 'munch' 19:07:58 Could not load 'network_segment_create': No module named 'munch' 19:07:58 Could not load 'network_segment_delete': No module named 'munch' 19:07:58 Could not load 'network_segment_list': No module named 'munch' 19:07:58 Could not load 'network_segment_range_create': No module named 'munch' 19:07:58 Could not load 'network_segment_range_delete': No module named 'munch' 19:07:58 Could not load 'network_segment_range_list': No module named 'munch' 19:07:58 Could not load 'network_segment_range_set': No module named 'munch' 19:07:58 Could not load 'network_segment_range_show': No module named 'munch' 19:07:58 Could not load 'network_segment_set': No module named 'munch' 19:07:58 Could not load 'network_segment_show': No module named 'munch' 19:07:58 Could not load 'network_set': No module named 'munch' 19:07:58 Could not load 'network_show': No module named 'munch' 19:07:58 Could not load 'network_unset': No module named 'munch' 19:07:58 Could not load 'port_create': No module named 'munch' 19:07:58 Could not load 'port_delete': No module named 'munch' 19:07:58 Could not load 'port_list': No module named 'munch' 19:07:58 Could not load 'port_set': No module named 'munch' 19:07:58 Could not load 'port_show': No module named 'munch' 19:07:58 Could not load 'port_unset': No module named 'munch' 19:07:58 Could not load 'router_add_port': No module named 'munch' 19:07:58 Could not load 'router_add_route': No module named 'munch' 19:07:58 Could not load 'router_add_subnet': No module named 'munch' 19:07:58 Could not load 'router_create': No module named 'munch' 19:07:58 Could not load 'router_delete': No module named 'munch' 19:07:58 Could not load 'router_list': No module named 'munch' 19:07:58 Could not load 'router_remove_port': No module named 'munch' 19:07:58 Could not load 'router_remove_route': No module named 'munch' 19:07:58 Could not load 'router_remove_subnet': No module named 'munch' 19:07:58 Could not load 'router_set': No module named 'munch' 19:07:58 Could not load 'router_show': No module named 'munch' 19:07:58 Could not load 'router_unset': No module named 'munch' 19:07:58 Could not load 'security_group_create': No module named 'munch' 19:07:58 Could not load 'security_group_delete': No module named 'munch' 19:07:58 Could not load 'security_group_list': No module named 'munch' 19:07:58 Could not load 'security_group_rule_create': No module named 'munch' 19:07:58 Could not load 'security_group_rule_delete': No module named 'munch' 19:07:58 Could not load 'security_group_rule_list': No module named 'munch' 19:07:58 Could not load 'security_group_rule_show': No module named 'munch' 19:07:58 Could not load 'security_group_set': No module named 'munch' 19:07:58 Could not load 'security_group_show': No module named 'munch' 19:07:58 Could not load 'security_group_unset': No module named 'munch' 19:07:58 Could not load 'subnet_create': No module named 'munch' 19:07:58 Could not load 'subnet_delete': No module named 'munch' 19:07:58 Could not load 'subnet_list': No module named 'munch' 19:07:58 Could not load 'subnet_pool_create': No module named 'munch' 19:07:58 Could not load 'subnet_pool_delete': No module named 'munch' 19:07:58 Could not load 'subnet_pool_list': No module named 'munch' 19:07:58 Could not load 'subnet_pool_set': No module named 'munch' 19:07:58 Could not load 'subnet_pool_show': No module named 'munch' 19:07:58 Could not load 'subnet_pool_unset': No module named 'munch' 19:07:58 Could not load 'subnet_set': No module named 'munch' 19:07:58 Could not load 'subnet_show': No module named 'munch' 19:07:58 Could not load 'subnet_unset': No module named 'munch' 19:08:02 + echo '-----> Active clusters -> stacks' 19:08:02 -----> Active clusters -> stacks 19:08:02 + OS_COE_STACKS=() 19:08:02 + [[ 0 -gt 0 ]] 19:08:02 + mapfile -t OS_STACKS 19:08:02 ++ openstack --os-cloud vex stack list -f value -c 'Stack Name' -c 'Stack Status' --property stack_status=CREATE_COMPLETE --property stack_status=DELETE_FAILED --property stack_status=CREATE_FAILED 19:08:02 ++ awk '{print $1}' 19:08:03 Could not load 'address_scope_create': No module named 'munch' 19:08:03 Could not load 'address_scope_delete': No module named 'munch' 19:08:03 Could not load 'address_scope_list': No module named 'munch' 19:08:03 Could not load 'address_scope_set': No module named 'munch' 19:08:03 Could not load 'address_scope_show': No module named 'munch' 19:08:03 Could not load 'floating_ip_create': No module named 'munch' 19:08:03 Could not load 'floating_ip_delete': No module named 'munch' 19:08:03 Could not load 'floating_ip_list': No module named 'munch' 19:08:03 Could not load 'floating_ip_port_forwarding_create': No module named 'munch' 19:08:03 Could not load 'floating_ip_port_forwarding_delete': No module named 'munch' 19:08:03 Could not load 'floating_ip_port_forwarding_list': No module named 'munch' 19:08:03 Could not load 'floating_ip_port_forwarding_set': No module named 'munch' 19:08:03 Could not load 'floating_ip_port_forwarding_show': No module named 'munch' 19:08:03 Could not load 'floating_ip_set': No module named 'munch' 19:08:03 Could not load 'floating_ip_show': No module named 'munch' 19:08:03 Could not load 'floating_ip_unset': No module named 'munch' 19:08:03 Could not load 'ip_availability_list': No module named 'munch' 19:08:03 Could not load 'ip_availability_show': No module named 'munch' 19:08:03 Could not load 'network_agent_add_network': No module named 'munch' 19:08:03 Could not load 'network_agent_add_router': No module named 'munch' 19:08:03 Could not load 'network_agent_delete': No module named 'munch' 19:08:03 Could not load 'network_agent_list': No module named 'munch' 19:08:03 Could not load 'network_agent_remove_network': No module named 'munch' 19:08:03 Could not load 'network_agent_remove_router': No module named 'munch' 19:08:03 Could not load 'network_agent_set': No module named 'munch' 19:08:03 Could not load 'network_agent_show': No module named 'munch' 19:08:03 Could not load 'network_auto_allocated_topology_create': No module named 'munch' 19:08:03 Could not load 'network_auto_allocated_topology_delete': No module named 'munch' 19:08:03 Could not load 'network_create': No module named 'munch' 19:08:03 Could not load 'network_delete': No module named 'munch' 19:08:03 Could not load 'network_flavor_add_profile': No module named 'munch' 19:08:03 Could not load 'network_flavor_create': No module named 'munch' 19:08:03 Could not load 'network_flavor_delete': No module named 'munch' 19:08:03 Could not load 'network_flavor_list': No module named 'munch' 19:08:03 Could not load 'network_flavor_profile_create': No module named 'munch' 19:08:03 Could not load 'network_flavor_profile_delete': No module named 'munch' 19:08:03 Could not load 'network_flavor_profile_list': No module named 'munch' 19:08:03 Could not load 'network_flavor_profile_set': No module named 'munch' 19:08:03 Could not load 'network_flavor_profile_show': No module named 'munch' 19:08:03 Could not load 'network_flavor_remove_profile': No module named 'munch' 19:08:03 Could not load 'network_flavor_set': No module named 'munch' 19:08:03 Could not load 'network_flavor_show': No module named 'munch' 19:08:03 Could not load 'network_list': No module named 'munch' 19:08:03 Could not load 'network_meter_create': No module named 'munch' 19:08:03 Could not load 'network_meter_delete': No module named 'munch' 19:08:03 Could not load 'network_meter_list': No module named 'munch' 19:08:03 Could not load 'network_meter_rule_create': No module named 'munch' 19:08:03 Could not load 'network_meter_rule_delete': No module named 'munch' 19:08:03 Could not load 'network_meter_rule_list': No module named 'munch' 19:08:03 Could not load 'network_meter_rule_show': No module named 'munch' 19:08:03 Could not load 'network_meter_show': No module named 'munch' 19:08:03 Could not load 'network_qos_policy_create': No module named 'munch' 19:08:03 Could not load 'network_qos_policy_delete': No module named 'munch' 19:08:03 Could not load 'network_qos_policy_list': No module named 'munch' 19:08:03 Could not load 'network_qos_policy_set': No module named 'munch' 19:08:03 Could not load 'network_qos_policy_show': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_create': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_delete': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_list': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_set': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_show': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_type_list': No module named 'munch' 19:08:03 Could not load 'network_qos_rule_type_show': No module named 'munch' 19:08:03 Could not load 'network_rbac_create': No module named 'munch' 19:08:03 Could not load 'network_rbac_delete': No module named 'munch' 19:08:03 Could not load 'network_rbac_list': No module named 'munch' 19:08:03 Could not load 'network_rbac_set': No module named 'munch' 19:08:03 Could not load 'network_rbac_show': No module named 'munch' 19:08:03 Could not load 'network_segment_create': No module named 'munch' 19:08:03 Could not load 'network_segment_delete': No module named 'munch' 19:08:03 Could not load 'network_segment_list': No module named 'munch' 19:08:03 Could not load 'network_segment_range_create': No module named 'munch' 19:08:03 Could not load 'network_segment_range_delete': No module named 'munch' 19:08:03 Could not load 'network_segment_range_list': No module named 'munch' 19:08:03 Could not load 'network_segment_range_set': No module named 'munch' 19:08:03 Could not load 'network_segment_range_show': No module named 'munch' 19:08:03 Could not load 'network_segment_set': No module named 'munch' 19:08:03 Could not load 'network_segment_show': No module named 'munch' 19:08:03 Could not load 'network_set': No module named 'munch' 19:08:03 Could not load 'network_show': No module named 'munch' 19:08:03 Could not load 'network_unset': No module named 'munch' 19:08:03 Could not load 'port_create': No module named 'munch' 19:08:03 Could not load 'port_delete': No module named 'munch' 19:08:03 Could not load 'port_list': No module named 'munch' 19:08:03 Could not load 'port_set': No module named 'munch' 19:08:03 Could not load 'port_show': No module named 'munch' 19:08:03 Could not load 'port_unset': No module named 'munch' 19:08:03 Could not load 'router_add_port': No module named 'munch' 19:08:03 Could not load 'router_add_route': No module named 'munch' 19:08:03 Could not load 'router_add_subnet': No module named 'munch' 19:08:03 Could not load 'router_create': No module named 'munch' 19:08:03 Could not load 'router_delete': No module named 'munch' 19:08:03 Could not load 'router_list': No module named 'munch' 19:08:03 Could not load 'router_remove_port': No module named 'munch' 19:08:03 Could not load 'router_remove_route': No module named 'munch' 19:08:03 Could not load 'router_remove_subnet': No module named 'munch' 19:08:03 Could not load 'router_set': No module named 'munch' 19:08:03 Could not load 'router_show': No module named 'munch' 19:08:03 Could not load 'router_unset': No module named 'munch' 19:08:03 Could not load 'security_group_create': No module named 'munch' 19:08:03 Could not load 'security_group_delete': No module named 'munch' 19:08:03 Could not load 'security_group_list': No module named 'munch' 19:08:03 Could not load 'security_group_rule_create': No module named 'munch' 19:08:03 Could not load 'security_group_rule_delete': No module named 'munch' 19:08:03 Could not load 'security_group_rule_list': No module named 'munch' 19:08:03 Could not load 'security_group_rule_show': No module named 'munch' 19:08:03 Could not load 'security_group_set': No module named 'munch' 19:08:03 Could not load 'security_group_show': No module named 'munch' 19:08:03 Could not load 'security_group_unset': No module named 'munch' 19:08:03 Could not load 'subnet_create': No module named 'munch' 19:08:03 Could not load 'subnet_delete': No module named 'munch' 19:08:03 Could not load 'subnet_list': No module named 'munch' 19:08:03 Could not load 'subnet_pool_create': No module named 'munch' 19:08:03 Could not load 'subnet_pool_delete': No module named 'munch' 19:08:03 Could not load 'subnet_pool_list': No module named 'munch' 19:08:03 Could not load 'subnet_pool_set': No module named 'munch' 19:08:03 Could not load 'subnet_pool_show': No module named 'munch' 19:08:03 Could not load 'subnet_pool_unset': No module named 'munch' 19:08:03 Could not load 'subnet_set': No module named 'munch' 19:08:03 Could not load 'subnet_show': No module named 'munch' 19:08:03 Could not load 'subnet_unset': No module named 'munch' 19:08:04 + echo '-----> Active stacks' 19:08:04 -----> Active stacks 19:08:04 + echo '-----> Delete orphaned stacks' 19:08:04 -----> Delete orphaned stacks 19:08:04 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:08:04 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:08:04 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins3831537417170952172.sh 19:08:05 ---> Orphaned servers 19:08:05 Setup pyenv: 19:08:05 system 19:08:05 3.8.13 19:08:05 3.9.13 19:08:05 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:08:05 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:08:08 lf-activate-venv(): INFO: Installing: lftools[openstack] kubernetes niet python-heatclient python-openstackclient python-magnumclient yq 19:08:31 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:08:32 Could not load 'address_scope_create': No module named 'munch' 19:08:32 Could not load 'address_scope_delete': No module named 'munch' 19:08:32 Could not load 'address_scope_list': No module named 'munch' 19:08:32 Could not load 'address_scope_set': No module named 'munch' 19:08:32 Could not load 'address_scope_show': No module named 'munch' 19:08:32 Could not load 'floating_ip_create': No module named 'munch' 19:08:32 Could not load 'floating_ip_delete': No module named 'munch' 19:08:32 Could not load 'floating_ip_list': No module named 'munch' 19:08:32 Could not load 'floating_ip_port_forwarding_create': No module named 'munch' 19:08:32 Could not load 'floating_ip_port_forwarding_delete': No module named 'munch' 19:08:32 Could not load 'floating_ip_port_forwarding_list': No module named 'munch' 19:08:32 Could not load 'floating_ip_port_forwarding_set': No module named 'munch' 19:08:32 Could not load 'floating_ip_port_forwarding_show': No module named 'munch' 19:08:32 Could not load 'floating_ip_set': No module named 'munch' 19:08:32 Could not load 'floating_ip_show': No module named 'munch' 19:08:32 Could not load 'floating_ip_unset': No module named 'munch' 19:08:32 Could not load 'ip_availability_list': No module named 'munch' 19:08:32 Could not load 'ip_availability_show': No module named 'munch' 19:08:32 Could not load 'network_agent_add_network': No module named 'munch' 19:08:32 Could not load 'network_agent_add_router': No module named 'munch' 19:08:32 Could not load 'network_agent_delete': No module named 'munch' 19:08:32 Could not load 'network_agent_list': No module named 'munch' 19:08:32 Could not load 'network_agent_remove_network': No module named 'munch' 19:08:32 Could not load 'network_agent_remove_router': No module named 'munch' 19:08:32 Could not load 'network_agent_set': No module named 'munch' 19:08:32 Could not load 'network_agent_show': No module named 'munch' 19:08:32 Could not load 'network_auto_allocated_topology_create': No module named 'munch' 19:08:32 Could not load 'network_auto_allocated_topology_delete': No module named 'munch' 19:08:32 Could not load 'network_create': No module named 'munch' 19:08:32 Could not load 'network_delete': No module named 'munch' 19:08:32 Could not load 'network_flavor_add_profile': No module named 'munch' 19:08:32 Could not load 'network_flavor_create': No module named 'munch' 19:08:32 Could not load 'network_flavor_delete': No module named 'munch' 19:08:32 Could not load 'network_flavor_list': No module named 'munch' 19:08:32 Could not load 'network_flavor_profile_create': No module named 'munch' 19:08:32 Could not load 'network_flavor_profile_delete': No module named 'munch' 19:08:32 Could not load 'network_flavor_profile_list': No module named 'munch' 19:08:32 Could not load 'network_flavor_profile_set': No module named 'munch' 19:08:32 Could not load 'network_flavor_profile_show': No module named 'munch' 19:08:32 Could not load 'network_flavor_remove_profile': No module named 'munch' 19:08:32 Could not load 'network_flavor_set': No module named 'munch' 19:08:32 Could not load 'network_flavor_show': No module named 'munch' 19:08:32 Could not load 'network_list': No module named 'munch' 19:08:32 Could not load 'network_meter_create': No module named 'munch' 19:08:32 Could not load 'network_meter_delete': No module named 'munch' 19:08:32 Could not load 'network_meter_list': No module named 'munch' 19:08:32 Could not load 'network_meter_rule_create': No module named 'munch' 19:08:32 Could not load 'network_meter_rule_delete': No module named 'munch' 19:08:32 Could not load 'network_meter_rule_list': No module named 'munch' 19:08:32 Could not load 'network_meter_rule_show': No module named 'munch' 19:08:32 Could not load 'network_meter_show': No module named 'munch' 19:08:32 Could not load 'network_qos_policy_create': No module named 'munch' 19:08:32 Could not load 'network_qos_policy_delete': No module named 'munch' 19:08:32 Could not load 'network_qos_policy_list': No module named 'munch' 19:08:32 Could not load 'network_qos_policy_set': No module named 'munch' 19:08:32 Could not load 'network_qos_policy_show': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_create': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_delete': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_list': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_set': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_show': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_type_list': No module named 'munch' 19:08:32 Could not load 'network_qos_rule_type_show': No module named 'munch' 19:08:32 Could not load 'network_rbac_create': No module named 'munch' 19:08:32 Could not load 'network_rbac_delete': No module named 'munch' 19:08:32 Could not load 'network_rbac_list': No module named 'munch' 19:08:32 Could not load 'network_rbac_set': No module named 'munch' 19:08:32 Could not load 'network_rbac_show': No module named 'munch' 19:08:32 Could not load 'network_segment_create': No module named 'munch' 19:08:32 Could not load 'network_segment_delete': No module named 'munch' 19:08:32 Could not load 'network_segment_list': No module named 'munch' 19:08:32 Could not load 'network_segment_range_create': No module named 'munch' 19:08:32 Could not load 'network_segment_range_delete': No module named 'munch' 19:08:32 Could not load 'network_segment_range_list': No module named 'munch' 19:08:32 Could not load 'network_segment_range_set': No module named 'munch' 19:08:32 Could not load 'network_segment_range_show': No module named 'munch' 19:08:32 Could not load 'network_segment_set': No module named 'munch' 19:08:32 Could not load 'network_segment_show': No module named 'munch' 19:08:32 Could not load 'network_set': No module named 'munch' 19:08:32 Could not load 'network_show': No module named 'munch' 19:08:32 Could not load 'network_unset': No module named 'munch' 19:08:32 Could not load 'port_create': No module named 'munch' 19:08:32 Could not load 'port_delete': No module named 'munch' 19:08:32 Could not load 'port_list': No module named 'munch' 19:08:32 Could not load 'port_set': No module named 'munch' 19:08:32 Could not load 'port_show': No module named 'munch' 19:08:32 Could not load 'port_unset': No module named 'munch' 19:08:32 Could not load 'router_add_port': No module named 'munch' 19:08:32 Could not load 'router_add_route': No module named 'munch' 19:08:32 Could not load 'router_add_subnet': No module named 'munch' 19:08:32 Could not load 'router_create': No module named 'munch' 19:08:32 Could not load 'router_delete': No module named 'munch' 19:08:32 Could not load 'router_list': No module named 'munch' 19:08:32 Could not load 'router_remove_port': No module named 'munch' 19:08:32 Could not load 'router_remove_route': No module named 'munch' 19:08:32 Could not load 'router_remove_subnet': No module named 'munch' 19:08:32 Could not load 'router_set': No module named 'munch' 19:08:32 Could not load 'router_show': No module named 'munch' 19:08:32 Could not load 'router_unset': No module named 'munch' 19:08:32 Could not load 'security_group_create': No module named 'munch' 19:08:32 Could not load 'security_group_delete': No module named 'munch' 19:08:32 Could not load 'security_group_list': No module named 'munch' 19:08:32 Could not load 'security_group_rule_create': No module named 'munch' 19:08:32 Could not load 'security_group_rule_delete': No module named 'munch' 19:08:32 Could not load 'security_group_rule_list': No module named 'munch' 19:08:32 Could not load 'security_group_rule_show': No module named 'munch' 19:08:32 Could not load 'security_group_set': No module named 'munch' 19:08:32 Could not load 'security_group_show': No module named 'munch' 19:08:32 Could not load 'security_group_unset': No module named 'munch' 19:08:32 Could not load 'subnet_create': No module named 'munch' 19:08:32 Could not load 'subnet_delete': No module named 'munch' 19:08:32 Could not load 'subnet_list': No module named 'munch' 19:08:32 Could not load 'subnet_pool_create': No module named 'munch' 19:08:32 Could not load 'subnet_pool_delete': No module named 'munch' 19:08:32 Could not load 'subnet_pool_list': No module named 'munch' 19:08:32 Could not load 'subnet_pool_set': No module named 'munch' 19:08:32 Could not load 'subnet_pool_show': No module named 'munch' 19:08:32 Could not load 'subnet_pool_unset': No module named 'munch' 19:08:32 Could not load 'subnet_set': No module named 'munch' 19:08:32 Could not load 'subnet_show': No module named 'munch' 19:08:32 Could not load 'subnet_unset': No module named 'munch' 19:08:36 -----> Active servers 19:08:36 prd-centos8-builder-1c-1g-4399 19:08:36 -----> Delete orphaned servers 19:08:37 [Boolean condition] checking [True] against [^(1|y|yes|t|true|on|run)$] (origin token: True) 19:08:37 Run condition [Boolean condition] enabling perform for step [Execute shell] 19:08:37 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins15542650013002257619.sh 19:08:38 ---> Orphaned ports 19:08:38 Setup pyenv: 19:08:38 system 19:08:38 3.8.13 19:08:38 3.9.13 19:08:38 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:08:38 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:08:41 lf-activate-venv(): INFO: Installing: lftools[openstack] python-openstackclient 19:09:01 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:09:02 Could not load 'address_scope_create': No module named 'munch' 19:09:02 Could not load 'address_scope_delete': No module named 'munch' 19:09:02 Could not load 'address_scope_list': No module named 'munch' 19:09:02 Could not load 'address_scope_set': No module named 'munch' 19:09:02 Could not load 'address_scope_show': No module named 'munch' 19:09:02 Could not load 'floating_ip_create': No module named 'munch' 19:09:02 Could not load 'floating_ip_delete': No module named 'munch' 19:09:02 Could not load 'floating_ip_list': No module named 'munch' 19:09:02 Could not load 'floating_ip_port_forwarding_create': No module named 'munch' 19:09:02 Could not load 'floating_ip_port_forwarding_delete': No module named 'munch' 19:09:02 Could not load 'floating_ip_port_forwarding_list': No module named 'munch' 19:09:02 Could not load 'floating_ip_port_forwarding_set': No module named 'munch' 19:09:02 Could not load 'floating_ip_port_forwarding_show': No module named 'munch' 19:09:02 Could not load 'floating_ip_set': No module named 'munch' 19:09:02 Could not load 'floating_ip_show': No module named 'munch' 19:09:02 Could not load 'floating_ip_unset': No module named 'munch' 19:09:02 Could not load 'ip_availability_list': No module named 'munch' 19:09:02 Could not load 'ip_availability_show': No module named 'munch' 19:09:02 Could not load 'network_agent_add_network': No module named 'munch' 19:09:02 Could not load 'network_agent_add_router': No module named 'munch' 19:09:02 Could not load 'network_agent_delete': No module named 'munch' 19:09:02 Could not load 'network_agent_list': No module named 'munch' 19:09:02 Could not load 'network_agent_remove_network': No module named 'munch' 19:09:02 Could not load 'network_agent_remove_router': No module named 'munch' 19:09:02 Could not load 'network_agent_set': No module named 'munch' 19:09:02 Could not load 'network_agent_show': No module named 'munch' 19:09:02 Could not load 'network_auto_allocated_topology_create': No module named 'munch' 19:09:02 Could not load 'network_auto_allocated_topology_delete': No module named 'munch' 19:09:02 Could not load 'network_create': No module named 'munch' 19:09:02 Could not load 'network_delete': No module named 'munch' 19:09:02 Could not load 'network_flavor_add_profile': No module named 'munch' 19:09:02 Could not load 'network_flavor_create': No module named 'munch' 19:09:02 Could not load 'network_flavor_delete': No module named 'munch' 19:09:02 Could not load 'network_flavor_list': No module named 'munch' 19:09:02 Could not load 'network_flavor_profile_create': No module named 'munch' 19:09:02 Could not load 'network_flavor_profile_delete': No module named 'munch' 19:09:02 Could not load 'network_flavor_profile_list': No module named 'munch' 19:09:02 Could not load 'network_flavor_profile_set': No module named 'munch' 19:09:02 Could not load 'network_flavor_profile_show': No module named 'munch' 19:09:02 Could not load 'network_flavor_remove_profile': No module named 'munch' 19:09:02 Could not load 'network_flavor_set': No module named 'munch' 19:09:02 Could not load 'network_flavor_show': No module named 'munch' 19:09:02 Could not load 'network_list': No module named 'munch' 19:09:02 Could not load 'network_meter_create': No module named 'munch' 19:09:02 Could not load 'network_meter_delete': No module named 'munch' 19:09:02 Could not load 'network_meter_list': No module named 'munch' 19:09:02 Could not load 'network_meter_rule_create': No module named 'munch' 19:09:02 Could not load 'network_meter_rule_delete': No module named 'munch' 19:09:02 Could not load 'network_meter_rule_list': No module named 'munch' 19:09:02 Could not load 'network_meter_rule_show': No module named 'munch' 19:09:02 Could not load 'network_meter_show': No module named 'munch' 19:09:02 Could not load 'network_qos_policy_create': No module named 'munch' 19:09:02 Could not load 'network_qos_policy_delete': No module named 'munch' 19:09:02 Could not load 'network_qos_policy_list': No module named 'munch' 19:09:02 Could not load 'network_qos_policy_set': No module named 'munch' 19:09:02 Could not load 'network_qos_policy_show': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_create': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_delete': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_list': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_set': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_show': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_type_list': No module named 'munch' 19:09:02 Could not load 'network_qos_rule_type_show': No module named 'munch' 19:09:02 Could not load 'network_rbac_create': No module named 'munch' 19:09:02 Could not load 'network_rbac_delete': No module named 'munch' 19:09:02 Could not load 'network_rbac_list': No module named 'munch' 19:09:02 Could not load 'network_rbac_set': No module named 'munch' 19:09:02 Could not load 'network_rbac_show': No module named 'munch' 19:09:02 Could not load 'network_segment_create': No module named 'munch' 19:09:02 Could not load 'network_segment_delete': No module named 'munch' 19:09:02 Could not load 'network_segment_list': No module named 'munch' 19:09:02 Could not load 'network_segment_range_create': No module named 'munch' 19:09:02 Could not load 'network_segment_range_delete': No module named 'munch' 19:09:02 Could not load 'network_segment_range_list': No module named 'munch' 19:09:02 Could not load 'network_segment_range_set': No module named 'munch' 19:09:02 Could not load 'network_segment_range_show': No module named 'munch' 19:09:02 Could not load 'network_segment_set': No module named 'munch' 19:09:02 Could not load 'network_segment_show': No module named 'munch' 19:09:02 Could not load 'network_set': No module named 'munch' 19:09:02 Could not load 'network_show': No module named 'munch' 19:09:02 Could not load 'network_unset': No module named 'munch' 19:09:02 Could not load 'port_create': No module named 'munch' 19:09:02 Could not load 'port_delete': No module named 'munch' 19:09:02 Could not load 'port_list': No module named 'munch' 19:09:02 Could not load 'port_set': No module named 'munch' 19:09:02 Could not load 'port_show': No module named 'munch' 19:09:02 Could not load 'port_unset': No module named 'munch' 19:09:02 Could not load 'router_add_port': No module named 'munch' 19:09:02 Could not load 'router_add_route': No module named 'munch' 19:09:02 Could not load 'router_add_subnet': No module named 'munch' 19:09:02 Could not load 'router_create': No module named 'munch' 19:09:02 Could not load 'router_delete': No module named 'munch' 19:09:02 Could not load 'router_list': No module named 'munch' 19:09:02 Could not load 'router_remove_port': No module named 'munch' 19:09:02 Could not load 'router_remove_route': No module named 'munch' 19:09:02 Could not load 'router_remove_subnet': No module named 'munch' 19:09:02 Could not load 'router_set': No module named 'munch' 19:09:02 Could not load 'router_show': No module named 'munch' 19:09:02 Could not load 'router_unset': No module named 'munch' 19:09:02 Could not load 'security_group_create': No module named 'munch' 19:09:02 Could not load 'security_group_delete': No module named 'munch' 19:09:02 Could not load 'security_group_list': No module named 'munch' 19:09:02 Could not load 'security_group_rule_create': No module named 'munch' 19:09:02 Could not load 'security_group_rule_delete': No module named 'munch' 19:09:02 Could not load 'security_group_rule_list': No module named 'munch' 19:09:02 Could not load 'security_group_rule_show': No module named 'munch' 19:09:02 Could not load 'security_group_set': No module named 'munch' 19:09:02 Could not load 'security_group_show': No module named 'munch' 19:09:02 Could not load 'security_group_unset': No module named 'munch' 19:09:02 Could not load 'subnet_create': No module named 'munch' 19:09:02 Could not load 'subnet_delete': No module named 'munch' 19:09:02 Could not load 'subnet_list': No module named 'munch' 19:09:02 Could not load 'subnet_pool_create': No module named 'munch' 19:09:02 Could not load 'subnet_pool_delete': No module named 'munch' 19:09:02 Could not load 'subnet_pool_list': No module named 'munch' 19:09:02 Could not load 'subnet_pool_set': No module named 'munch' 19:09:02 Could not load 'subnet_pool_show': No module named 'munch' 19:09:02 Could not load 'subnet_pool_unset': No module named 'munch' 19:09:02 Could not load 'subnet_set': No module named 'munch' 19:09:02 Could not load 'subnet_show': No module named 'munch' 19:09:02 Could not load 'subnet_unset': No module named 'munch' 19:09:02 Build step 'Conditional step (single)' marked build as failure 19:09:02 $ ssh-agent -k 19:09:02 unset SSH_AUTH_SOCK; 19:09:02 unset SSH_AGENT_PID; 19:09:02 echo Agent pid 5166 killed; 19:09:02 [ssh-agent] Stopped. 19:09:03 [PostBuildScript] - [INFO] Executing post build scripts. 19:09:03 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7469409149267155845.sh 19:09:03 ---> sysstat.sh 19:09:04 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins7911377030760891719.sh 19:09:04 ---> package-listing.sh 19:09:04 ++ facter osfamily 19:09:04 ++ tr '[:upper:]' '[:lower:]' 19:09:05 + OS_FAMILY=redhat 19:09:05 + workspace=/w/workspace/ci-management-openstack-cron 19:09:05 + START_PACKAGES=/tmp/packages_start.txt 19:09:05 + END_PACKAGES=/tmp/packages_end.txt 19:09:05 + DIFF_PACKAGES=/tmp/packages_diff.txt 19:09:05 + PACKAGES=/tmp/packages_start.txt 19:09:05 + '[' /w/workspace/ci-management-openstack-cron ']' 19:09:05 + PACKAGES=/tmp/packages_end.txt 19:09:05 + case "${OS_FAMILY}" in 19:09:05 + rpm -qa 19:09:05 + sort 19:09:12 + '[' -f /tmp/packages_start.txt ']' 19:09:12 + '[' -f /tmp/packages_end.txt ']' 19:09:12 + diff /tmp/packages_start.txt /tmp/packages_end.txt 19:09:12 + '[' /w/workspace/ci-management-openstack-cron ']' 19:09:12 + mkdir -p /w/workspace/ci-management-openstack-cron/archives/ 19:09:12 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/ci-management-openstack-cron/archives/ 19:09:12 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins3530115521197178669.sh 19:09:12 ---> capture-instance-metadata.sh 19:09:12 Setup pyenv: 19:09:12 system 19:09:12 3.8.13 19:09:12 3.9.13 19:09:12 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:09:13 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:09:15 lf-activate-venv(): INFO: Installing: lftools 19:09:31 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:09:31 INFO: Running in OpenStack, capturing instance metadata 19:09:32 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14849086212383289207.sh 19:09:32 provisioning config files... 19:09:32 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/ci-management-openstack-cron@tmp/config779727001468948124tmp 19:09:32 Regular expression run condition: Expression=[^.*logs-s3.*], Label=[] 19:09:32 Run condition [Regular expression match] preventing perform for step [Provide Configuration files] 19:09:32 [EnvInject] - Injecting environment variables from a build step. 19:09:32 [EnvInject] - Injecting as environment variables the properties content 19:09:32 SERVER_ID=logs 19:09:32 19:09:32 [EnvInject] - Variables injected successfully. 19:09:32 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins14777021257546120487.sh 19:09:32 ---> create-netrc.sh 19:09:32 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins18366302024643485539.sh 19:09:32 ---> python-tools-install.sh 19:09:32 Setup pyenv: 19:09:32 system 19:09:32 3.8.13 19:09:32 3.9.13 19:09:32 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:09:32 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:09:35 lf-activate-venv(): INFO: Installing: lftools 19:09:50 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:09:50 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins12448775233026162392.sh 19:09:50 ---> sudo-logs.sh 19:09:50 Archiving 'sudo' log.. 19:09:51 [ci-management-openstack-cron] $ /bin/bash /tmp/jenkins17282216732803325945.sh 19:09:51 ---> job-cost.sh 19:09:51 Setup pyenv: 19:09:51 system 19:09:51 3.8.13 19:09:51 3.9.13 19:09:51 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:09:51 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:09:54 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient urllib3~=1.26.15 19:10:04 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:10:04 INFO: No Stack... 19:10:06 INFO: Retrieving Pricing Info for: v2-highcpu-1 19:10:06 INFO: Archiving Costs 19:10:06 [ci-management-openstack-cron] $ /bin/bash -l /tmp/jenkins8110097284076166038.sh 19:10:06 ---> logs-deploy.sh 19:10:06 Setup pyenv: 19:10:06 system 19:10:06 3.8.13 19:10:06 3.9.13 19:10:06 * 3.10.6 (set by /w/workspace/ci-management-openstack-cron/.python-version) 19:10:06 lf-activate-venv(): INFO: Reuse venv:/tmp/venv-vDQR from file:/tmp/.os_lf_venv 19:10:08 lf-activate-venv(): INFO: Installing: lftools 19:10:24 lf-activate-venv(): INFO: Adding /tmp/venv-vDQR/bin to PATH 19:10:24 INFO: Nexus URL https://nexus.o-ran-sc.org path production/vex-sjc-oran-jenkins-prod-1/ci-management-openstack-cron/42332 19:10:24 INFO: archiving workspace using pattern(s): 19:10:27 Archives upload complete. 19:10:27 INFO: archiving logs to Nexus 19:10:29 ---> uname -a: 19:10:29 Linux prd-centos8-builder-1c-1g-4399.novalocal 4.18.0-529.el8.x86_64 #1 SMP Wed Dec 6 01:03:46 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux 19:10:29 19:10:29 19:10:29 ---> lscpu: 19:10:29 Architecture: x86_64 19:10:29 CPU op-mode(s): 32-bit, 64-bit 19:10:29 Byte Order: Little Endian 19:10:29 CPU(s): 1 19:10:29 On-line CPU(s) list: 0 19:10:29 Thread(s) per core: 1 19:10:29 Core(s) per socket: 1 19:10:29 Socket(s): 1 19:10:29 NUMA node(s): 1 19:10:29 Vendor ID: AuthenticAMD 19:10:29 CPU family: 23 19:10:29 Model: 49 19:10:29 Model name: AMD EPYC-Rome Processor 19:10:29 Stepping: 0 19:10:29 CPU MHz: 2799.998 19:10:29 BogoMIPS: 5599.99 19:10:29 Virtualization: AMD-V 19:10:29 Hypervisor vendor: KVM 19:10:29 Virtualization type: full 19:10:29 L1d cache: 32K 19:10:29 L1i cache: 32K 19:10:29 L2 cache: 512K 19:10:29 L3 cache: 16384K 19:10:29 NUMA node0 CPU(s): 0 19:10:29 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm rep_good nopl cpuid extd_apicid tsc_known_freq pni pclmulqdq ssse3 fma cx16 sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext perfctr_core ssbd ibrs ibpb stibp vmmcall fsgsbase tsc_adjust bmi1 avx2 smep bmi2 rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr wbnoinvd arat npt nrip_save umip rdpid arch_capabilities 19:10:29 19:10:29 19:10:29 ---> nproc: 19:10:29 1 19:10:29 19:10:29 19:10:29 ---> df -h: 19:10:29 Filesystem Size Used Avail Use% Mounted on 19:10:29 devtmpfs 329M 0 329M 0% /dev 19:10:29 tmpfs 386M 0 386M 0% /dev/shm 19:10:29 tmpfs 386M 11M 376M 3% /run 19:10:29 tmpfs 386M 0 386M 0% /sys/fs/cgroup 19:10:29 /dev/vda1 20G 9.0G 12G 45% / 19:10:29 tmpfs 78M 0 78M 0% /run/user/1001 19:10:29 19:10:29 19:10:29 ---> free -m: 19:10:29 total used free shared buff/cache available 19:10:29 Mem: 770 301 65 5 402 338 19:10:29 Swap: 1023 19 1004 19:10:29 19:10:29 19:10:29 ---> ip addr: 19:10:29 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 19:10:29 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 19:10:29 inet 127.0.0.1/8 scope host lo 19:10:29 valid_lft forever preferred_lft forever 19:10:29 inet6 ::1/128 scope host 19:10:29 valid_lft forever preferred_lft forever 19:10:29 2: eth0: mtu 1450 qdisc fq_codel state UP group default qlen 1000 19:10:29 link/ether fa:16:3e:98:6c:2f brd ff:ff:ff:ff:ff:ff 19:10:29 altname enp0s3 19:10:29 altname ens3 19:10:29 inet 10.32.6.14/23 brd 10.32.7.255 scope global dynamic noprefixroute eth0 19:10:29 valid_lft 86006sec preferred_lft 86006sec 19:10:29 inet6 fe80::f816:3eff:fe98:6c2f/64 scope link 19:10:29 valid_lft forever preferred_lft forever 19:10:29 19:10:29 19:10:29 ---> sar -b -r -n DEV: 19:10:29 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 03/12/2024 _x86_64_ (1 CPU) 19:10:29 19:10:29 19:03:46 LINUX RESTART (1 CPU) 19:10:29 19:10:29 07:04:01 PM tps rtps wtps bread/s bwrtn/s 19:10:29 07:05:01 PM 262.69 208.61 54.08 16095.99 39092.69 19:10:29 07:06:02 PM 97.54 27.93 69.61 3276.47 7494.39 19:10:29 07:07:01 PM 92.53 15.09 77.44 1518.85 8245.30 19:10:29 07:08:01 PM 68.76 25.56 43.19 1322.18 4425.33 19:10:29 07:09:01 PM 22.12 3.33 18.79 271.55 525.42 19:10:29 07:10:01 PM 110.44 93.07 17.36 7282.17 516.23 19:10:29 07:10:01 PM 0.00 0.00 0.00 0.00 0.00 19:10:29 Average: 109.07 62.40 46.66 4971.41 10055.03 19:10:29 19:10:29 07:04:01 PM kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 19:10:29 07:05:01 PM 51068 379248 738144 93.53 2104 399668 439700 23.93 105160 470928 692 19:10:29 07:06:02 PM 74748 305400 714464 90.53 656 305556 534556 29.09 135628 438260 16896 19:10:29 07:07:01 PM 59224 298572 729988 92.50 304 307020 529304 28.80 125252 442464 29484 19:10:29 07:08:01 PM 161520 351904 627692 79.53 304 256916 474912 25.84 123336 337908 4584 19:10:29 07:09:01 PM 90088 287508 699124 88.59 304 264524 543900 29.60 149932 385776 16 19:10:29 07:10:01 PM 81792 343968 707420 89.64 0 328892 492028 26.77 170840 377304 1208 19:10:29 07:10:01 PM 81792 343988 707420 89.64 0 328892 492028 26.77 170840 377232 1208 19:10:29 Average: 85747 330084 703465 89.14 525 313067 500918 27.26 140141 404267 7727 19:10:29 19:10:29 07:04:01 PM IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 19:10:29 07:05:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:05:01 PM eth0 140.76 73.80 660.81 48.87 0.00 0.00 0.00 0.00 19:10:29 07:06:02 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:06:02 PM eth0 70.39 54.15 788.46 6.34 0.00 0.00 0.00 0.00 19:10:29 07:07:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:07:01 PM eth0 25.72 22.25 239.57 7.79 0.00 0.00 0.00 0.00 19:10:29 07:08:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:08:01 PM eth0 21.95 20.70 253.47 6.10 0.00 0.00 0.00 0.00 19:10:29 07:09:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:09:01 PM eth0 11.18 14.26 12.20 5.62 0.00 0.00 0.00 0.00 19:10:29 07:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:10:01 PM eth0 13.60 13.83 11.42 10.11 0.00 0.00 0.00 0.00 19:10:29 07:10:01 PM lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:10:01 PM eth0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 Average: eth0 47.33 33.20 327.91 14.16 0.00 0.00 0.00 0.00 19:10:29 19:10:29 19:10:29 ---> sar -P ALL: 19:10:29 Linux 4.18.0-529.el8.x86_64 (centos-stream-8-builder-7e611857-ce8d-42da-b0f0-357f5fb5fb5a.nov) 03/12/2024 _x86_64_ (1 CPU) 19:10:29 19:10:29 19:03:46 LINUX RESTART (1 CPU) 19:10:29 19:10:29 07:04:01 PM CPU %user %nice %system %iowait %steal %idle 19:10:29 07:05:01 PM all 62.17 0.12 23.24 6.16 6.79 1.52 19:10:29 07:05:01 PM 0 62.17 0.12 23.24 6.16 6.79 1.52 19:10:29 07:06:02 PM all 71.02 0.02 10.93 2.09 5.86 10.08 19:10:29 07:06:02 PM 0 71.02 0.02 10.93 2.09 5.86 10.08 19:10:29 07:07:01 PM all 73.56 0.00 9.57 1.94 6.49 8.43 19:10:29 07:07:01 PM 0 73.56 0.00 9.57 1.94 6.49 8.43 19:10:29 07:08:01 PM all 69.52 0.00 7.14 3.10 5.59 14.66 19:10:29 07:08:01 PM 0 69.52 0.00 7.14 3.10 5.59 14.66 19:10:29 07:09:01 PM all 72.48 0.00 4.34 0.83 4.72 17.63 19:10:29 07:09:01 PM 0 72.48 0.00 4.34 0.83 4.72 17.63 19:10:29 07:10:01 PM all 71.06 0.00 6.32 11.08 4.91 6.63 19:10:29 07:10:01 PM 0 71.06 0.00 6.32 11.08 4.91 6.63 19:10:29 07:10:01 PM all 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 07:10:01 PM 0 0.00 0.00 0.00 0.00 0.00 0.00 19:10:29 Average: all 69.96 0.02 10.25 4.21 5.73 9.83 19:10:29 Average: 0 69.96 0.02 10.25 4.21 5.73 9.83 19:10:29 19:10:29 19:10:29