Hello all,
has anyone had similar issues/knows how to fix the issue ? I want to try out the new orchestrator, i have a tiny lab 2 hosts + 1 vcenter 6.7.
I am deploying vRO via ova, answered all the questions, used fqdn, right ip/dns/mask etc, i can login to vRO machine, it can resolve via name/ip vc/esx/vro.
If i open the vRO website i get: 'bad gateway', when i login to the vro box itself i see that vco container is not running, any idea how to go from here?
Installed from O11N_VA-8.0.1.7355-15296158_OVF10.ova i installed it from extracted ova as well, same result.
Image may be NSFW.
Clik here to view.
appliance console look:
Image may be NSFW.
Clik here to view.
dns
Image may be NSFW.
Clik here to view.
Image may be NSFW.
Clik here to view.
containers:
root@vro [ ~ ]# kubectl get pods --all-namespaces
NAMESPACE NAME READY STATUS RESTARTS AGE
ingress ingress-ctl-traefik-67cc495d5c-rkhnj 1/1 Running 1 16h
kube-system coredns-6922m 1/1 Running 1 16h
kube-system endpoints-weight-dddmx 1/1 Running 1 16h
kube-system etcd-vro.infralab.local 1/1 Running 1 16h
kube-system health-reporting-app-7hg2m 1/1 Running 1 16h
kube-system kube-apiserver-vro.infralab.local 1/1 Running 1 16h
kube-system kube-controller-manager-vro.infralab.local 1/1 Running 1 16h
kube-system kube-flannel-ds-f2957 2/2 Running 2 16h
kube-system kube-proxy-gbbmg 1/1 Running 1 16h
kube-system kube-scheduler-vro.infralab.local 1/1 Running 1 16h
kube-system kubelet-rubber-stamp-z9sh6 1/1 Running 1 16h
kube-system metrics-server-cms97 1/1 Running 1 16h
kube-system predictable-pod-scheduler-lz9k5 1/1 Running 1 16h
kube-system prelude-noop-extnet-ds-mkm6s 1/1 Running 1 16h
kube-system prelude-noop-intnet-ds-zdnn4 2/2 Running 2 16h
kube-system state-enforcement-cron-1584085320-wkf2k 0/1 Completed 0 3m24s
kube-system state-enforcement-cron-1584085440-22zbr 0/1 Error 0 51s
kube-system state-enforcement-cron-1584085440-crqws 0/1 Error 0 81s
kube-system state-enforcement-cron-1584085440-hxr2v 0/1 Error 0 11s
kube-system state-enforcement-cron-1584085440-llmjt 0/1 Error 0 84s
kube-system state-enforcement-cron-1584085440-wjq8p 0/1 Error 0 71s
kube-system tiller-deploy-89fdbcb48-m7kl7 1/1 Running 1 16h
prelude orchestration-ui-app-86947f69d-vk9x8 1/1 Running 1 16h
prelude pgpool-5f5c55b9bd-7qwgt 1/1 Running 2 16h
prelude postgres-0 1/1 Running 1 16h
prelude proxy-service-dlxcx 1/1 Running 1 16h
prelude symphony-logging-daemonset-s75l5 1/1 Running 1 16h
prelude vco-app-778f85f7bc-qttcx 0/2 Init:CrashLoopBackOff 4 15h
vro website
Image may be NSFW.
Clik here to view.
All i did is just deploy from ova nothing more. i also did the same thing at different environment but i deployed it to VC 6.0 and it worked there, i don't see any reason why it should not work deployed to 6.7 build 10244857
i have completely now i idea how to troubleshoot it, i found /var/log/containers and i can correlate those logs to containers name
the containers that are in failed state last lines of logs
tail -n 50 vco-app-778f85f7bc-qttcx_prelude_install-rpms-511f56c3931d4fdd22b1a7bb32ec0b4241899e70a720e873cce0c3c4a4227904.log
{"log":"vco-cfg-cli-8.0.1.1576058314-15282010 ########################################\n","stream":"stdout","time":"2020-03-13T07:49:51.433780448Z"}
{"log":"warning: user vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.434921086Z"}
{"log":"warning: group vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.434955111Z"}
{"log":"warning: user vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.436257558Z"}
{"log":"warning: group vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.436284833Z"}
{"log":"warning: user vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.436759513Z"}
{"log":"warning: group vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.436801222Z"}
{"log":"warning: user vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.437533823Z"}
{"log":"warning: group vco does not exist - using root\n","stream":"stderr","time":"2020-03-13T07:49:51.437580895Z"}
{"log":"/init_run.sh: line 126: /usr/lib/vco/app-server/bin/vco-reset-keystore-password.sh: No such file or directory\n","stream":"stderr","time":"2020-03-13T07:49:52.318109806Z"}
{"log":"Missing /usr/lib/vco/keystore.password file. Falling back to default value for keystore password...\n","stream":"stdout","time":"2020-03-13T07:49:52.375283518Z"}
{"log":"Orchestrator's root folder: /usr/lib/vco\n","stream":"stdout","time":"2020-03-13T07:49:52.797000465Z"}
{"log":"Orchestrator Configuration Tool. Version: 8.0.1.15282010 Build: 15282010\n","stream":"stdout","time":"2020-03-13T07:49:52.799879067Z"}
{"log":"\n","stream":"stdout","time":"2020-03-13T07:49:52.799898621Z"}
{"log":"Can not read the Orchestrator pid from /usr/lib/vco/app-server/logs/tomcat.pid\n","stream":"stderr","time":"2020-03-13T07:49:52.833717508Z"}
{"log":"Start configuring database settings.\n","stream":"stdout","time":"2020-03-13T07:49:53.405862003Z"}
{"log":"2020-03-13 07:49:53,507 [INFO] File not found: /usr/lib/vco/app-server/conf/vmo.properties. Return empty byte array.\n","stream":"stdout","time":"2020-03-13T07:49:53.508271318Z"}
{"log":"2020-03-13 07:49:53,524 [INFO] File not found: /usr/lib/vco/app-server/conf/security/passwordencryptor.key. Return empty byte array.\n","stream":"stdout","time":"2020-03-13T07:49:53.524189158Z"}
{"log":"Property source file is missing and failed to create it. File: '/usr/lib/vco/app-server/conf/vmo.properties'\n","stream":"stdout","time":"2020-03-13T07:49:53.53281343Z"}
{"log":"java.lang.RuntimeException: Property source file is missing and failed to create it. File: '/usr/lib/vco/app-server/conf/vmo.properties'\n","stream":"stdout","time":"2020-03-13T07:49:53.532829392Z"}
{"log":"\u0009at com.vmware.o11n.settings.impl.PropFileSettingsSource.assureSourceExist(PropFileSettingsSource.java:291) ~[o11n-settings-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532832378Z"}
{"log":"\u0009at com.vmware.o11n.settings.impl.PropFileSettingsSource.save(PropFileSettingsSource.java:270) ~[o11n-settings-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532834827Z"}
{"log":"\u0009at com.vmware.o11n.settings.impl.PropFileSettingsSource.put(PropFileSettingsSource.java:108) ~[o11n-settings-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532837Z"}
{"log":"\u0009at com.vmware.o11n.settings.proxies.SettingsInvocationHandler.invoke(SettingsInvocationHandler.java:107) ~[o11n-app-settings-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.53283928Z"}
{"log":"\u0009at com.sun.proxy.$Proxy28.setDriverClassname(Unknown Source) ~[?:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532841536Z"}
{"log":"\u0009at com.vmware.o11n.cli.configuration.commands.db.DbCommand.persistSettings(DbCommand.java:119) ~[o11n-commandline-configuration-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532843651Z"}
{"log":"\u0009at com.vmware.o11n.cli.configuration.commands.db.DbCommand.execute(DbCommand.java:91) ~[o11n-commandline-configuration-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.5328458Z"}
{"log":"\u0009at com.vmware.o11n.cli.configuration.commands.ConfigurationCommand.executeCmd(ConfigurationCommand.java:120) ~[o11n-commandline-configuration-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532848058Z"}
{"log":"\u0009at com.vmware.o11n.cli.configuration.ConfigurationCli.executeCommand(ConfigurationCli.java:122) [o11n-commandline-configuration-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532864747Z"}
{"log":"\u0009at com.vmware.o11n.cli.configuration.ConfigurationCli.main(ConfigurationCli.java:98) [o11n-commandline-configuration-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532867321Z"}
{"log":"Caused by: java.io.IOException: No such file or directory\n","stream":"stdout","time":"2020-03-13T07:49:53.532869554Z"}
{"log":"\u0009at java.io.UnixFileSystem.createFileExclusively(Native Method) ~[?:1.8.0-internal]\n","stream":"stdout","time":"2020-03-13T07:49:53.532871663Z"}
{"log":"\u0009at java.io.File.createNewFile(File.java:1012) ~[?:1.8.0-internal]\n","stream":"stdout","time":"2020-03-13T07:49:53.532873766Z"}
{"log":"\u0009at com.vmware.o11n.settings.impl.PropFileSettingsSource.assureSourceExist(PropFileSettingsSource.java:289) ~[o11n-settings-8.0.1.jar:?]\n","stream":"stdout","time":"2020-03-13T07:49:53.532875827Z"}
{"log":"\u0009... 9 more\n","stream":"stdout","time":"2020-03-13T07:49:53.532878036Z"}
{"log":"ERROR: Unable to configure database.\n","stream":"stdout","time":"2020-03-13T07:49:53.537741992Z"}
root@vro [ /var/log/containers ]# tail -n 50 vco-app-778f85f7bc-qttcx_prelude_vco-dependencies-48347f5b45ead243fa473ccab44c786ec184ccb191a4640b9434fdba29c1dad8.log
{"log":"2020/03/13 07:37:32 Loading dependencies from /dependencies/init-dependencies.yaml\n","stream":"stderr","time":"2020-03-13T07:37:32.029703426Z"}
{"log":"2020/03/13 07:37:32 Loading k8s config\n","stream":"stderr","time":"2020-03-13T07:37:32.029768005Z"}
{"log":"2020/03/13 07:37:32 Creading k8s clientset\n","stream":"stderr","time":"2020-03-13T07:37:32.029893689Z"}
{"log":"2020/03/13 07:37:32 Reading current namespace\n","stream":"stderr","time":"2020-03-13T07:37:32.030813647Z"}
{"log":"2020/03/13 07:37:32 Running in namespace prelude\n","stream":"stderr","time":"2020-03-13T07:37:32.030834968Z"}
{"log":"2020/03/13 07:37:32 Running checks\n","stream":"stderr","time":"2020-03-13T07:37:32.030839661Z"}
Wiadomość była edytowana przez: Grzegorz
Clik here to view.