Unsolved
4 Posts
0
9033
VXrail update hangs on 65%
Hi,
I was trying to do an update of our VXRail. But now it hangs.
In the VXRail manager i uploaded the update package. But now the update hangs on 65% (Bootstap deployment in progress ...) for a couple of days now. Does anyone know how to delete the update that is in progress, or how to fix this issue? We rebooted the VXRail manager several times, restarted Marvin services. But that didn't help.
Hardware: QuantaPlex T41S-2U (4-Node)
VXRail software version: VxRail 4.5.212-8993025
Uploaded update package: 4.7.000 Release with vSphere 6.7 U1
Thanks.
aculee
1 Message
0
November 29th, 2018 12:00
I'm having the exact same issue with my upgrade. Did you get it to install?
Martijnp
4 Posts
0
November 30th, 2018 02:00
No, the update still hangs on 65%. I have no fix yet.
Bill_Leslie
56 Posts
0
November 30th, 2018 13:00
Please see KB Article 000493138. https://support.emc.com/kb/493138
(Must login to see it.)
Martijnp
4 Posts
0
December 3rd, 2018 05:00
Thank you for your answer. None of the mentioned solutions resolved my problem.
I checked the lcm.log file for more information. I do see some errors here and there, but i haven't got a clue where to look now.
i created a snapshot of the vxmanager vm. Then i removed the package file: data/store2/lcm/VXRAIL_COMPOSITE-4.7.000-10825283_for_4.5.x.zip and the bootstrap.sh.
But that also didn't help.
Log:
2018-11-19T14:46:45.925+0100 INFO [SimpleAsyncTaskExecutor-1] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:46:46.046+0100 INFO [SimpleAsyncTaskExecutor-1] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.deploy:101 - Extracting bootstrap.sh from /data/store2/lcm/DL91565_VxRail-4.7.000-Composite-Upgrade-Package-for-4.5.x.zip?source=ACG\
2018-11-19T14:46:47.911+0100 INFO [tomcat-http--35] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:46:51.209+0100 INFO [tomcat-http--10] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:46:54.576+0100 INFO [tomcat-http--39] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:46:57.910+0100 INFO [tomcat-http--12] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:02.001+0100 INFO [tomcat-http--21] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:05.326+0100 INFO [tomcat-http--42] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:09.320+0100 INFO [tomcat-http--40] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:12.823+0100 INFO [tomcat-http--32] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:16.165+0100 INFO [tomcat-http--31] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:20.195+0100 INFO [tomcat-http--17] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:23.487+0100 INFO [tomcat-http--33] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:26.914+0100 INFO [tomcat-http--2] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:30.399+0100 INFO [tomcat-http--38] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:33.704+0100 INFO [tomcat-http--39] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:37.125+0100 INFO [tomcat-http--3] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:40.456+0100 INFO [tomcat-http--24] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:44.010+0100 INFO [tomcat-http--9] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:47.358+0100 INFO [tomcat-http--15] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:50.754+0100 INFO [tomcat-http--8] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:54.051+0100 INFO [tomcat-http--43] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:47:57.271+0100 INFO [tomcat-http--34] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:00.670+0100 INFO [tomcat-http--38] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:05.305+0100 INFO [tomcat-http--38] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:08.926+0100 INFO [tomcat-http--23] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:15.186+0100 INFO [tomcat-http--28] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:18.693+0100 INFO [tomcat-http--28] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:23.310+0100 INFO [tomcat-http--8] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:26.975+0100 INFO [tomcat-http--43] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:30.454+0100 INFO [tomcat-http--12] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:34.385+0100 INFO [tomcat-http--34] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:40.017+0100 INFO [tomcat-http--14] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:43.424+0100 INFO [tomcat-http--24] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:47.503+0100 INFO [tomcat-http--31] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:50.837+0100 INFO [tomcat-http--6] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:54.092+0100 INFO [tomcat-http--18] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:48:57.752+0100 INFO [tomcat-http--37] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:02.139+0100 INFO [tomcat-http--45] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:05.563+0100 INFO [tomcat-http--9] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:09.028+0100 INFO [tomcat-http--48] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:15.683+0100 INFO [tomcat-http--11] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:19.086+0100 INFO [tomcat-http--36] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:26.224+0100 INFO [tomcat-http--26] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:30.038+0100 INFO [tomcat-http--20] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:34.003+0100 INFO [tomcat-http--33] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:37.418+0100 INFO [tomcat-http--35] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:41.212+0100 INFO [tomcat-http--45] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:44.823+0100 INFO [tomcat-http--28] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:48.229+0100 INFO [tomcat-http--34] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:49.941+0100 INFO [SimpleAsyncTaskExecutor-1] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:158 - Estimated total size of upgrade bundle is : 4509932303 bytes.\
2018-11-19T14:49:52.659+0100 INFO [tomcat-http--34] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:56.046+0100 INFO [tomcat-http--21] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:49:59.459+0100 INFO [tomcat-http--36] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:02.859+0100 INFO [tomcat-http--31] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:06.146+0100 INFO [tomcat-http--6] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:09.565+0100 INFO [tomcat-http--43] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:13.016+0100 INFO [tomcat-http--7] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:16.433+0100 INFO [tomcat-http--1] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:20.415+0100 INFO [tomcat-http--28] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:24.952+0100 INFO [tomcat-http--22] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:28.263+0100 INFO [tomcat-http--29] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:31.482+0100 INFO [tomcat-http--10] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:35.800+0100 INFO [tomcat-http--15] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:39.148+0100 INFO [tomcat-http--41] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:42.533+0100 INFO [tomcat-http--39] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:45.892+0100 INFO [tomcat-http--13] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:49.155+0100 INFO [tomcat-http--8] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:52.467+0100 INFO [tomcat-http--32] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:55.755+0100 INFO [tomcat-http--49] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:50:59.058+0100 INFO [tomcat-http--28] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:51:02.450+0100 INFO [tomcat-http--4] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:51:05.740+0100 INFO [tomcat-http--4] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:53:03.540+0100 INFO [SimpleAsyncTaskExecutor-1] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:182 - Found bootstrap.sh in /data/store2/lcm/DL91565_VxRail-4.7.000-Composite-Upgrade-Package-for-4.5.x.zip?source=ACG and unzip it.\
2018-11-19T14:53:03.548+0100 INFO [SimpleAsyncTaskExecutor-1] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.triggerDeployScript:180 - Executing the /data/store2/lcm/bootstrap.sh, database related ERROR message from the script can be expected but ignorable\
2018-11-19T14:53:33.584+0100 ERROR [SimpleAsyncTaskExecutor-1] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-19T14:53:33.585+0100 WARN [SimpleAsyncTaskExecutor-1] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/data/store2/lcm/bootstrap.sh]: Timed out, null return code.\
2018-11-19T14:53:33.779+0100 INFO [SimpleAsyncTaskExecutor-2] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:53:33.782+0100 INFO [SimpleAsyncTaskExecutor-2] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.deploy:101 - Extracting bootstrap.sh from /data/store2/lcm/DL91565_VxRail-4.7.000-Composite-Upgrade-Package-for-4.5.x.zip?source=ACG\
2018-11-19T14:56:36.401+0100 INFO [SimpleAsyncTaskExecutor-2] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:158 - Estimated total size of upgrade bundle is : 4509932303 bytes.\
2018-11-19T14:59:26.046+0100 INFO [SimpleAsyncTaskExecutor-2] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:182 - Found bootstrap.sh in /data/store2/lcm/DL91565_VxRail-4.7.000-Composite-Upgrade-Package-for-4.5.x.zip?source=ACG and unzip it.\
2018-11-19T14:59:26.052+0100 INFO [SimpleAsyncTaskExecutor-2] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.triggerDeployScript:180 - Executing the /data/store2/lcm/bootstrap.sh, database related ERROR message from the script can be expected but ignorable\
2018-11-19T14:59:56.115+0100 ERROR [SimpleAsyncTaskExecutor-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-19T14:59:56.117+0100 WARN [SimpleAsyncTaskExecutor-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/data/store2/lcm/bootstrap.sh]: Timed out, null return code.\
2018-11-19T14:59:56.349+0100 INFO [SimpleAsyncTaskExecutor-3] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-19T14:59:56.356+0100 INFO [SimpleAsyncTaskExecutor-3] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.deploy:101 - Extracting bootstrap.sh from /data/store2/lcm/DL91565_VxRail-4.7.000-Composite-Upgrade-Package-for-4.5.x.zip?source=ACG\
2018-11-19T15:02:15.168+0100 INFO [tomcat-http--23] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-19T15:02:35.723+0100 INFO [tomcat-http--23] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-19T15:02:35.827+0100 INFO [tomcat-http--23] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-19T15:02:35.839+0100 INFO [tomcat-http--23] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-19T15:03:28.143+0100 INFO [SimpleAsyncTaskExecutor-3] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:158 - Estimated total size of upgrade bundle is : 4509932303 bytes.\
2018-11-19T15:04:20.296+0100 INFO [tomcat-http--13] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-19T15:04:41.621+0100 INFO [tomcat-http--13] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-19T15:04:41.771+0100 INFO [tomcat-http--13] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-19T15:04:41.788+0100 INFO [tomcat-http--13] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-19T16:34:03.860+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:116 - PostConstruct:reloadAllowedAuthorities\
2018-11-19T16:34:03.951+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:130 - Allowing authority permanently for cert /var/lib/vmware-marvin/trust/08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75 (08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75)\
2018-11-19T16:34:03.965+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadCrl:141 - reloadCrl\
2018-11-19T16:34:14.358+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:46 - start parse hardware model spec configuration file ...\
2018-11-19T16:34:14.561+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.readContentsFromFile:94 - Loading /hardware-model-specs.json\
2018-11-19T16:34:14.883+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:48 - end of parsing hardware model spec configuration file\
2018-11-19T16:38:51.048+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T16:38:51.057+0100 INFO [localhost-startStop-1] com.vce.lcm.configuration.LcmProperties LcmProperties.loadPropertiesFromFile:106 - Found lcm-application.properties at the application level.\
2018-11-19T16:38:55.123+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T16:38:55.146+0100 WARN [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:160 - Cannot find alarm checklist xml at application level \
2018-11-19T16:38:55.156+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:167 - find alarm checklist xml at thread level\
2018-11-19T16:38:55.300+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.init:98 - alarm checklist is enabled.\
2018-11-19T16:39:05.815+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:84 - Writing file /var/lib/vmware-marvin/upgrade-task-config.json\
2018-11-19T16:39:06.092+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:88 - Writing file \{\
"tasks" : [ \{\
"taskName" : "VcLicenseConfigurationTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RenameVcvaAfterUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateNewVcvaRepositoryTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DeletePortgroupTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RecoverDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ReconfigurevSphereHAOnClusterTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewPscViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewPscTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PSCDeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewVcsaStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureManagementPermissionTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateManagementAccountTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewPscStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewVcsaViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewVcsaTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VCSADeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "MigrateVCSAHardwareConfigTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PrepareVC65UpgradeBundleTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateUpgradeNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DisableDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateDnsServerTask",\
"injectFailure" : false\
\} ]\
\}\
2018-11-19T16:39:06.947+0100 INFO [localhost-startStop-1] com.vce.lcm.service.upgrade.UpgraderMapService UpgraderMapService.createComponentUpgraderMap:64 - Creating appliances upgrader mappings\
2018-11-19T16:39:11.207+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.CheckerListMappingService CheckerListMappingService.createCheckListMapping:104 - Creating the checker list mappings.\
2018-11-19T16:39:14.998+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getClasspath:31 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T16:39:32.620+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Platform Services Controller\
2018-11-19T16:39:32.625+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Appliance\
2018-11-19T16:39:32.639+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vRealize Log Insight\
2018-11-19T16:39:32.647+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VxRail Manager\
2018-11-19T19:29:21.537+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:116 - PostConstruct:reloadAllowedAuthorities\
2018-11-19T19:29:21.708+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:130 - Allowing authority permanently for cert /var/lib/vmware-marvin/trust/08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75 (08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75)\
2018-11-19T19:29:21.743+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadCrl:141 - reloadCrl\
2018-11-19T19:29:29.157+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:46 - start parse hardware model spec configuration file ...\
2018-11-19T19:29:29.339+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.readContentsFromFile:94 - Loading /hardware-model-specs.json\
2018-11-19T19:29:29.640+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:48 - end of parsing hardware model spec configuration file\
2018-11-19T19:34:15.042+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T19:34:15.054+0100 INFO [localhost-startStop-1] com.vce.lcm.configuration.LcmProperties LcmProperties.loadPropertiesFromFile:106 - Found lcm-application.properties at the application level.\
2018-11-19T19:34:18.376+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T19:34:18.386+0100 WARN [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:160 - Cannot find alarm checklist xml at application level \
2018-11-19T19:34:18.392+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:167 - find alarm checklist xml at thread level\
2018-11-19T19:34:18.558+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.init:98 - alarm checklist is enabled.\
2018-11-19T19:34:35.167+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:84 - Writing file /var/lib/vmware-marvin/upgrade-task-config.json\
2018-11-19T19:34:36.281+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:88 - Writing file \{\
"tasks" : [ \{\
"taskName" : "VcLicenseConfigurationTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RenameVcvaAfterUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateNewVcvaRepositoryTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DeletePortgroupTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RecoverDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ReconfigurevSphereHAOnClusterTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewPscViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewPscTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PSCDeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewVcsaStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureManagementPermissionTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateManagementAccountTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewPscStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewVcsaViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewVcsaTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VCSADeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "MigrateVCSAHardwareConfigTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PrepareVC65UpgradeBundleTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateUpgradeNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DisableDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateDnsServerTask",\
"injectFailure" : false\
\} ]\
\}\
2018-11-19T19:34:38.798+0100 INFO [localhost-startStop-1] com.vce.lcm.service.upgrade.UpgraderMapService UpgraderMapService.createComponentUpgraderMap:64 - Creating appliances upgrader mappings\
2018-11-19T19:34:44.183+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.CheckerListMappingService CheckerListMappingService.createCheckListMapping:104 - Creating the checker list mappings.\
2018-11-19T19:34:48.546+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getClasspath:31 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-19T19:35:00.222+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Platform Services Controller\
2018-11-19T19:35:00.240+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Appliance\
2018-11-19T19:35:00.243+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vRealize Log Insight\
2018-11-19T19:35:00.248+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VxRail Manager\
2018-11-19T19:36:02.985+0100 INFO [localhost-startStop-1] com.vce.commons.core.repositories.TrackedHostRepositoryImpl TrackedHostRepositoryImpl.reload:81 - No file /var/lib/vmware-marvin/hosts.json\
2018-11-19T19:36:11.795+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-19T19:36:12.635+0100 INFO [myScheduler-2] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-19T19:36:12.642+0100 INFO [myScheduler-2] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-19T19:36:12.704+0100 INFO [myScheduler-2] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-19T19:37:01.038+0100 WARN [myScheduler-2] com.vce.commons.core.repositories.RuntimePropertiesRepositoryImpl RuntimePropertiesRepositoryImpl.getProperty:95 - Property data.moref.vmfolder not found\
2018-11-19T19:39:20.862+0100 INFO [myScheduler-5] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-19T19:39:20.864+0100 INFO [myScheduler-5] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-19T19:39:20.868+0100 INFO [myScheduler-5] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-19T19:39:46.394+0100 WARN [myScheduler-5] com.vce.commons.core.repositories.RuntimePropertiesRepositoryImpl RuntimePropertiesRepositoryImpl.getProperty:95 - Property data.moref.vmfolder not found\
2018-11-19T21:36:11.775+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-19T23:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T01:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T03:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T05:36:11.776+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T07:36:11.775+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T08:33:45.451+0100 INFO [tomcat-http--4] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-20T08:34:09.570+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-20T08:34:09.719+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-20T08:34:09.742+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-20T09:32:07.112+0100 INFO [tomcat-http--15] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-20T09:32:31.857+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-20T09:32:31.962+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-20T09:32:31.965+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-20T09:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T10:03:08.850+0100 INFO [tomcat-http--32] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-20T10:03:46.141+0100 INFO [tomcat-http--32] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-20T10:03:46.292+0100 INFO [tomcat-http--32] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-20T10:03:46.294+0100 INFO [tomcat-http--32] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-20T11:36:11.779+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T13:36:11.775+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T15:36:11.775+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T17:36:11.777+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T19:36:11.776+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T21:36:11.775+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-20T23:36:11.775+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T01:36:11.781+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T03:36:11.777+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T05:36:11.775+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T07:36:11.775+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T09:36:11.775+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T11:36:11.775+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T13:36:11.775+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T15:36:11.775+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T17:36:11.775+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T19:36:11.775+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T21:36:11.775+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-21T23:36:11.775+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T01:36:11.775+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T03:36:11.775+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T05:36:11.775+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T07:36:11.775+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T09:36:11.775+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T11:34:53.792+0100 INFO [tomcat-http--27] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-22T11:35:12.329+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-22T11:35:12.403+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-22T11:35:12.405+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-22T11:36:11.775+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T12:16:28.641+0100 INFO [tomcat-http--2] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-22T12:17:16.328+0100 INFO [tomcat-http--2] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-22T12:17:16.478+0100 INFO [tomcat-http--2] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-22T12:17:16.480+0100 INFO [tomcat-http--2] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-22T12:33:02.234+0100 INFO [tomcat-http--14] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.isSurrogateKillSwitchOff:67 - Surrogate kill switch is off\
2018-11-22T12:36:55.701+0100 INFO [tomcat-http--14] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.deploy:132 - MultiPart File is copied to /data/store2/lcm/VXRAIL_COMPOSITE-4.7.000-10825283_for_4.5.x.zip\
2018-11-22T12:36:55.740+0100 INFO [tomcat-http--14] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.deploy:135 - Extracting bootstrap.sh from /data/store2/lcm/VXRAIL_COMPOSITE-4.7.000-10825283_for_4.5.x.zip\
2018-11-22T12:41:43.112+0100 INFO [tomcat-http--14] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:158 - Estimated total size of upgrade bundle is : 4509932303 bytes.\
2018-11-22T12:46:10.251+0100 INFO [tomcat-http--14] com.vce.lcm.service.composite.CompositeBundleFileUnpacker CompositeBundleFileUnpacker.unzipCompositeBundleFile:182 - Found bootstrap.sh in /data/store2/lcm/VXRAIL_COMPOSITE-4.7.000-10825283_for_4.5.x.zip and unzip it.\
2018-11-22T12:46:10.263+0100 INFO [tomcat-http--14] com.vce.lcm.helper.SurrogateLcmDeployer SurrogateLcmDeployer.triggerDeployScript:180 - Executing the /data/store2/lcm/bootstrap.sh, database related ERROR message from the script can be expected but ignorable\
2018-11-22T12:46:40.331+0100 ERROR [tomcat-http--14] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-22T12:46:40.344+0100 WARN [tomcat-http--14] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/data/store2/lcm/bootstrap.sh]: Timed out, null return code.\
2018-11-22T13:24:55.759+0100 INFO [tomcat-http--15] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-22T13:25:20.586+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-22T13:25:20.664+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-22T13:25:20.671+0100 INFO [tomcat-http--15] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-22T13:36:11.775+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T13:36:25.413+0100 INFO [tomcat-http--1] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-22T13:37:32.500+0100 INFO [tomcat-http--1] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-22T13:37:32.624+0100 INFO [tomcat-http--1] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-22T13:37:32.632+0100 INFO [tomcat-http--1] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-22T15:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T16:09:10.227+0100 WARN [myScheduler-5] com.vce.commons.core.connection.VCEntity VCEntity.getProperty:65 - runtime.host is null\
2018-11-22T16:15:20.831+0100 INFO [tomcat-http--4] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-22T16:15:43.591+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-22T16:15:43.650+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-22T16:15:43.654+0100 INFO [tomcat-http--4] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-22T17:36:11.775+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T19:36:11.775+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T21:36:11.775+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-22T23:36:11.775+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T01:36:11.775+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T03:36:11.775+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T05:36:11.775+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T07:36:11.775+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T09:19:47.240+0100 INFO [tomcat-http--3] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T09:20:00.990+0100 INFO [tomcat-http--3] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-23T09:20:01.053+0100 INFO [tomcat-http--3] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-23T09:20:01.058+0100 INFO [tomcat-http--3] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-23T09:36:11.775+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T11:36:11.775+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T13:29:17.469+0100 INFO [tomcat-http--36] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T13:29:32.565+0100 INFO [tomcat-http--36] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-23T13:29:32.629+0100 INFO [tomcat-http--36] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-23T13:29:32.632+0100 INFO [tomcat-http--36] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-23T13:36:11.776+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T14:55:42.725+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:116 - PostConstruct:reloadAllowedAuthorities\
2018-11-23T14:55:42.993+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadAllowedAuthorities:130 - Allowing authority permanently for cert /var/lib/vmware-marvin/trust/08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75 (08:BE:D3:39:D3:E3:08:92:3A:1B:A9:4A:2C:CE:56:28:50:B2:63:75)\
2018-11-23T14:55:43.032+0100 INFO [localhost-startStop-1] com.vce.commons.core.ssl.MarvinTrustManager MarvinTrustManager.reloadCrl:141 - reloadCrl\
2018-11-23T14:55:51.582+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:46 - start parse hardware model spec configuration file ...\
2018-11-23T14:55:51.661+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.readContentsFromFile:94 - Loading /hardware-model-specs.json\
2018-11-23T14:55:51.892+0100 INFO [localhost-startStop-1] com.vce.commons.core.services.HardwareModelSpecProcessor HardwareModelSpecProcessor.afterPropertiesSet:48 - end of parsing hardware model spec configuration file\
2018-11-23T15:00:21.329+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-23T15:00:21.351+0100 INFO [localhost-startStop-1] com.vce.lcm.configuration.LcmProperties LcmProperties.loadPropertiesFromFile:106 - Found lcm-application.properties at the application level.\
2018-11-23T15:00:28.691+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getWebappRootPath:98 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-23T15:00:28.727+0100 WARN [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:160 - Cannot find alarm checklist xml at application level \
2018-11-23T15:00:28.758+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.findChecklistConfigFile:167 - find alarm checklist xml at thread level\
2018-11-23T15:00:29.209+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.AlarmChecker AlarmChecker.init:98 - alarm checklist is enabled.\
2018-11-23T15:00:45.486+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:84 - Writing file /var/lib/vmware-marvin/upgrade-task-config.json\
2018-11-23T15:00:46.117+0100 INFO [localhost-startStop-1] com.vce.lcm.task.repository.UpgradeTaskConfigurationRepositoryImpl UpgradeTaskConfigurationRepositoryImpl.setUpgradeConfigProperties:88 - Writing file \{\
"tasks" : [ \{\
"taskName" : "VcLicenseConfigurationTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RenameVcvaAfterUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateNewVcvaRepositoryTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DeletePortgroupTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "RecoverDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ReconfigurevSphereHAOnClusterTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewPscViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewPscTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PSCDeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewVcsaStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ConfigureManagementPermissionTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateManagementAccountTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "ApplyNewPscStoragePolicyTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PowerOffNewVcsaViaVcTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DestroyNewVcsaTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VCSADeploymentTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "MigrateVCSAHardwareConfigTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaStartUpgradeTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PrepareVC65UpgradeBundleTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "CreateUpgradeNetworkTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "DisableDrsAutomatedTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "PscEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "VcsaEnableSSHTask",\
"injectFailure" : false\
\}, \{\
"taskName" : "UpdateDnsServerTask",\
"injectFailure" : false\
\} ]\
\}\
2018-11-23T15:00:47.576+0100 INFO [localhost-startStop-1] com.vce.lcm.service.upgrade.UpgraderMapService UpgraderMapService.createComponentUpgraderMap:64 - Creating appliances upgrader mappings\
2018-11-23T15:00:55.231+0100 INFO [localhost-startStop-1] com.vce.lcm.service.checker.CheckerListMappingService CheckerListMappingService.createCheckListMapping:104 - Creating the checker list mappings.\
2018-11-23T15:01:02.699+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.AppPathUtils AppPathUtils.getClasspath:31 - package path : /usr/lib/vmware-marvin/marvind/webapps/extension/WEB-INF/lib/lcm_module-4.5.212.jar\
2018-11-23T15:01:10.211+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Platform Services Controller\
2018-11-23T15:01:10.219+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vCenter Server Appliance\
2018-11-23T15:01:10.226+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VMware vRealize Log Insight\
2018-11-23T15:01:10.232+0100 INFO [localhost-startStop-1] com.vce.commons.core.util.PatternCollectionUtil PatternCollectionUtil.splitPatternCSV:22 - Adding pattern : VxRail Manager\
2018-11-23T15:01:54.472+0100 INFO [localhost-startStop-1] com.vce.commons.core.repositories.TrackedHostRepositoryImpl TrackedHostRepositoryImpl.reload:81 - No file /var/lib/vmware-marvin/hosts.json\
2018-11-23T15:02:03.459+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T15:02:04.249+0100 INFO [myScheduler-2] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-23T15:02:04.278+0100 INFO [myScheduler-2] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-23T15:02:04.346+0100 INFO [myScheduler-2] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:03:00.192+0100 WARN [myScheduler-2] com.vce.commons.core.repositories.RuntimePropertiesRepositoryImpl RuntimePropertiesRepositoryImpl.getProperty:95 - Property data.moref.vmfolder not found\
2018-11-23T15:04:54.419+0100 INFO [myScheduler-5] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-23T15:04:54.426+0100 INFO [myScheduler-5] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-23T15:04:54.455+0100 INFO [myScheduler-5] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:05:20.234+0100 WARN [myScheduler-5] com.vce.commons.core.repositories.RuntimePropertiesRepositoryImpl RuntimePropertiesRepositoryImpl.getProperty:95 - Property data.moref.vmfolder not found\
2018-11-23T15:16:53.457+0100 INFO [tomcat-http--47] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:17:18.599+0100 INFO [tomcat-http--47] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-23T15:17:18.716+0100 INFO [tomcat-http--47] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-23T15:17:18.722+0100 INFO [tomcat-http--47] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-23T15:41:28.834+0100 WARN [myScheduler-5] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:442 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/is-esx-disk-local.py]: Non-zero return code: 1\
2018-11-23T15:41:28.836+0100 WARN [myScheduler-5] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:446 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/is-esx-disk-local.py@localhost]: Traceback (most recent call last):\
File "/usr/lib/vmware-marvin/marvind/temp/6142326559219022946.tmp", line 129, in \
main()\
File "/usr/lib/vmware-marvin/marvind/temp/6142326559219022946.tmp", line 107, in main\
user=options.vc_username, pwd=options.vc_password, version=VIM_VERSION)\
File "/usr/lib/python2.7/site-packages/pyVim/connect.py", line 242, in Connect\
File "/usr/lib/python2.7/site-packages/pyVim/connect.py", line 327, in __Login\
pyVmomi.VmomiSupport.HostConnectFault: (vim.fault.HostConnectFault) \{\
dynamicType = ,\
dynamicProperty = (vmodl.DynamicProperty) [],\
msg = '[Errno 111] Connection refused',\
faultCause = ,\
faultMessage = (vmodl.LocalizableMessage) []\
\}\
\
2018-11-23T15:42:29.551+0100 INFO [myScheduler-1] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-23T15:42:29.553+0100 INFO [myScheduler-1] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-23T15:42:29.555+0100 INFO [myScheduler-1] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:43:01.054+0100 ERROR [myScheduler-1] com.vce.commons.core.connection.services.ConnectionFactoryImpl ConnectionFactoryImpl.createVCConnection:94 - unable to connect to VC\
com.sun.xml.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused (Connection refused)\
at com.sun.xml.ws.transport.http.client.HttpClientTransport.getOutput(HttpClientTransport.java:131) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:223) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:145) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:139) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.__doRun(Fiber.java:1136) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber._doRun(Fiber.java:1050) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.doRun(Fiber.java:1019) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.runSync(Fiber.java:877) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.Stub.process(Stub.java:463) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SEIStub.doProcess(SEIStub.java:191) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:92) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:161) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.proxy.$Proxy453.retrieveServiceContent(Unknown Source) ~[?:?]\
at com.vce.commons.core.connection.services.VCLoginService.loginByBearerToken(VCLoginService.java:103) ~[commons-4.5.212.jar:?]\
at com.vce.commons.core.connection.services.ConnectionFactoryImpl.createVCConnection(ConnectionFactoryImpl.java:88) [commons-4.5.212.jar:?]\
at com.vce.commons.core.connection.services.ConnectionFactoryImpl.createVCConnection(ConnectionFactoryImpl.java:79) [commons-4.5.212.jar:?]\
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_172]\
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_172]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:52) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at com.sun.proxy.$Proxy245.createVCConnection(Unknown Source) [?:?]\
at com.vce.commons.core.services.ConnectionHelper.refreshConnection(ConnectionHelper.java:37) [commons-4.5.212.jar:?]\
at com.vce.commons.core.services.ConnectionHelper.getConnection(ConnectionHelper.java:67) [commons-4.5.212.jar:?]\
at com.vce.commons.core.services.ManagementConnectionServiceImpl.getManagementConnection(ManagementConnectionServiceImpl.java:50) [commons-4.5.212.jar:?]\
at com.emc.mystic.manager.web.service.stats.HardWareStatusServiceImpl.populateCache(HardWareStatusServiceImpl.java:72) [classes/:?]\
at sun.reflect.GeneratedMethodAccessor662.invoke(Unknown Source) ~[?:?]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheInterceptor$1.invoke(CacheInterceptor.java:52) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:345) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:408) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:327) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at com.sun.proxy.$Proxy373.populateCache(Unknown Source) [?:?]\
at com.emc.mystic.manager.web.service.stats.HardWareStatusFetchJob.fetchHardwareStatus(HardWareStatusFetchJob.java:47) [classes/:?]\
at sun.reflect.GeneratedMethodAccessor660.invoke(Unknown Source) ~[?:?]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:65) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_172]\
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_172]\
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_172]\
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_172]\
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_172]\
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_172]\
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]\
Caused by: java.net.ConnectException: Connection refused (Connection refused)\
at java.net.PlainSocketImpl.socketConnect(Native Method) ~[?:1.8.0_172]\
at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) ~[?:1.8.0_172]\
at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[?:1.8.0_172]\
at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[?:1.8.0_172]\
at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[?:1.8.0_172]\
at java.net.Socket.connect(Socket.java:589) ~[?:1.8.0_172]\
at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:673) ~[?:1.8.0_172]\
at sun.security.ssl.BaseSSLSocketImpl.connect(BaseSSLSocketImpl.java:173) ~[?:1.8.0_172]\
at sun.net.NetworkClient.doConnect(NetworkClient.java:180) ~[?:1.8.0_172]\
at sun.net.www.http.HttpClient.openServer(HttpClient.java:463) ~[?:1.8.0_172]\
at sun.net.www.http.HttpClient.openServer(HttpClient.java:558) ~[?:1.8.0_172]\
at sun.net.www.protocol.https.HttpsClient. (HttpsClient.java:264) ~[?:1.8.0_172]\
at sun.net.www.protocol.https.HttpsClient.New(HttpsClient.java:367) ~[?:1.8.0_172]\
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.getNewHttpClient(AbstractDelegateHttpsURLConnection.java:191) ~[?:1.8.0_172]\
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1199) ~[?:1.8.0_172]\
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1050) ~[?:1.8.0_172]\
at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:177) ~[?:1.8.0_172]\
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1334) ~[?:1.8.0_172]\
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1309) ~[?:1.8.0_172]\
at sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:259) ~[?:1.8.0_172]\
at com.sun.xml.ws.transport.http.client.HttpClientTransport.getOutput(HttpClientTransport.java:119) ~[jaxws-rt-2.2.10.jar:2.2.10]\
... 60 more\
2018-11-23T15:44:01.327+0100 INFO [myScheduler-10] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-23T15:44:01.331+0100 INFO [myScheduler-10] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-23T15:44:01.335+0100 INFO [myScheduler-10] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:44:10.258+0100 WARN [myScheduler-6] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:442 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/fetch-boot-device.py]: Non-zero return code: 1\
2018-11-23T15:44:10.260+0100 WARN [myScheduler-6] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:446 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/fetch-boot-device.py@localhost]: Error to ignore:(vim.fault.HostConnectFault) \{\
dynamicType = ,\
dynamicProperty = (vmodl.DynamicProperty) [],\
msg = '503 Service Unavailable (Failed to connect to endpoint: [N7Vmacore4Http16LocalServiceSpecE:0x000055de811313b0] _serverNamespace = /sdk action = Allow _port = 8085)',\
faultCause = ,\
faultMessage = (vmodl.LocalizableMessage) []\
\}\
Fail to get information of boot device.\
\
2018-11-23T15:44:18.920+0100 ERROR [myScheduler-10] com.vce.commons.core.connection.services.ConnectionFactoryImpl ConnectionFactoryImpl.createVCConnection:94 - unable to connect to VC\
com.sun.xml.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable (Failed to connect to endpoint: [N7Vmacore4Http16LocalServiceSpecE:0x000055de811313b0] _serverNamespace = /sdk action = Allow _port = 8085)\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.checkStatusCode(HttpTransportPipe.java:332) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.createResponsePacket(HttpTransportPipe.java:274) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.process(HttpTransportPipe.java:232) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.http.client.HttpTransportPipe.processRequest(HttpTransportPipe.java:145) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.transport.DeferredTransportPipe.processRequest(DeferredTransportPipe.java:139) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.__doRun(Fiber.java:1136) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber._doRun(Fiber.java:1050) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.doRun(Fiber.java:1019) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.api.pipe.Fiber.runSync(Fiber.java:877) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.Stub.process(Stub.java:463) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SEIStub.doProcess(SEIStub.java:191) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:92) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:161) ~[jaxws-rt-2.2.10.jar:2.2.10]\
at com.sun.proxy.$Proxy455.retrieveServiceContent(Unknown Source) ~[?:?]\
at com.vce.commons.core.connection.services.VCLoginService.loginByBearerToken(VCLoginService.java:103) ~[commons-4.5.212.jar:?]\
at com.vce.commons.core.connection.services.ConnectionFactoryImpl.createVCConnection(ConnectionFactoryImpl.java:88) [commons-4.5.212.jar:?]\
at com.vce.commons.core.connection.services.ConnectionFactoryImpl.createVCConnection(ConnectionFactoryImpl.java:79) [commons-4.5.212.jar:?]\
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_172]\
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_172]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:52) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at com.sun.proxy.$Proxy245.createVCConnection(Unknown Source) [?:?]\
at com.vce.commons.core.services.ConnectionHelper.refreshConnection(ConnectionHelper.java:37) [commons-4.5.212.jar:?]\
at com.vce.commons.core.services.ConnectionHelper.getConnection(ConnectionHelper.java:67) [commons-4.5.212.jar:?]\
at com.vce.commons.core.services.ManagementConnectionServiceImpl.getManagementConnection(ManagementConnectionServiceImpl.java:50) [commons-4.5.212.jar:?]\
at com.emc.mystic.manager.web.service.stats.HardWareStatusServiceImpl.populateCache(HardWareStatusServiceImpl.java:72) [classes/:?]\
at sun.reflect.GeneratedMethodAccessor662.invoke(Unknown Source) ~[?:?]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheInterceptor$1.invoke(CacheInterceptor.java:52) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.invokeOperation(CacheAspectSupport.java:345) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:408) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheAspectSupport.execute(CacheAspectSupport.java:327) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.cache.interceptor.CacheInterceptor.invoke(CacheInterceptor.java:61) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213) [spring-aop-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at com.sun.proxy.$Proxy373.populateCache(Unknown Source) [?:?]\
at com.emc.mystic.manager.web.service.stats.HardWareStatusFetchJob.fetchHardwareStatus(HardWareStatusFetchJob.java:47) [classes/:?]\
at sun.reflect.GeneratedMethodAccessor660.invoke(Unknown Source) ~[?:?]\
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_172]\
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_172]\
at org.springframework.scheduling.support.ScheduledMethodRunnable.run(ScheduledMethodRunnable.java:65) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54) [spring-context-4.3.6.RELEASE.jar:4.3.6.RELEASE]\
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_172]\
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) [?:1.8.0_172]\
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_172]\
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) [?:1.8.0_172]\
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_172]\
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_172]\
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172]\
2018-11-23T15:45:19.504+0100 INFO [myScheduler-4] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:34 - VC connection timed out, reconnecting.\
2018-11-23T15:45:19.509+0100 INFO [myScheduler-4] com.vce.commons.core.services.ConnectionHelper ConnectionHelper.refreshConnection:36 - Connecting to 172.16.0.22 username management@localos\
2018-11-23T15:45:19.512+0100 INFO [myScheduler-4] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T15:45:57.404+0100 WARN [myScheduler-4] com.vce.commons.core.repositories.RuntimePropertiesRepositoryImpl RuntimePropertiesRepositoryImpl.getProperty:95 - Property data.moref.vmfolder not found\
2018-11-23T15:46:29.464+0100 ERROR [myScheduler-4] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-23T15:46:29.543+0100 WARN [myScheduler-4] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-23T16:02:48.276+0100 INFO [tomcat-http--5] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-23T16:03:13.048+0100 INFO [tomcat-http--5] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-23T16:03:13.155+0100 INFO [tomcat-http--5] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-23T16:03:13.174+0100 INFO [tomcat-http--5] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-23T16:18:48.041+0100 ERROR [myScheduler-7] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-23T16:18:48.050+0100 WARN [myScheduler-7] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-23T17:02:03.455+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T19:02:03.454+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T21:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-23T23:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T01:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T03:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T05:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T07:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T09:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T11:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T13:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T15:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T17:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T19:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T21:02:04.242+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-24T23:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T01:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T03:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T05:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T07:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T09:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T11:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T13:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T15:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T17:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T19:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T21:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-25T23:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T01:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T03:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T05:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T07:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T09:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T11:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T13:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T15:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T17:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T19:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T21:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-26T23:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T01:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T02:56:21.300+0100 ERROR [myScheduler-4] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T02:56:21.309+0100 WARN [myScheduler-4] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T03:06:39.974+0100 ERROR [myScheduler-6] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:06:39.979+0100 WARN [myScheduler-6] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:10:19.102+0100 ERROR [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:10:19.109+0100 WARN [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:14:51.729+0100 ERROR [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:14:51.736+0100 WARN [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:19:15.262+0100 ERROR [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:19:15.266+0100 WARN [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:21:59.585+0100 ERROR [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:21:59.586+0100 WARN [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:24:01.288+0100 ERROR [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:24:01.293+0100 WARN [myScheduler-3] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T03:30:23.575+0100 ERROR [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:405 - Killing script after timeout - taken maximum 30000 ms.\
2018-11-27T03:30:23.581+0100 WARN [myScheduler-2] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:440 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Timed out, null return code.\
2018-11-27T05:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T07:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T08:20:01.075+0100 INFO [tomcat-http--45] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-27T08:20:02.988+0100 INFO [tomcat-http--45] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-27T08:20:03.053+0100 INFO [tomcat-http--45] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-27T08:20:03.054+0100 INFO [tomcat-http--45] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-27T09:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T10:23:58.822+0100 INFO [tomcat-http--40] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-27T10:24:00.280+0100 INFO [tomcat-http--40] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-27T10:24:00.310+0100 INFO [tomcat-http--40] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-27T10:24:00.312+0100 INFO [tomcat-http--40] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-27T11:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T13:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T13:55:04.117+0100 INFO [tomcat-http--49] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-27T13:55:06.761+0100 INFO [tomcat-http--49] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-27T13:55:06.787+0100 INFO [tomcat-http--49] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-27T13:55:06.788+0100 INFO [tomcat-http--49] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-27T15:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T17:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T19:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T21:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-27T23:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T01:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T03:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T05:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T07:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T09:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T11:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T13:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T15:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T17:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T19:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T21:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-28T23:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T01:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T03:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T05:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T07:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T09:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T11:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T13:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T15:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T17:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T19:02:04.241+0100 INFO [myScheduler-2] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T21:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-29T23:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T01:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T03:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T05:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T07:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T09:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T11:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T11:31:08.710+0100 INFO [tomcat-http--33] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-30T11:31:10.024+0100 INFO [tomcat-http--33] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-30T11:31:10.047+0100 INFO [tomcat-http--33] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-30T11:31:10.048+0100 INFO [tomcat-http--33] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-30T13:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T14:59:17.808+0100 INFO [tomcat-http--27] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-11-30T14:59:19.035+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-11-30T14:59:19.064+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-11-30T14:59:19.064+0100 INFO [tomcat-http--27] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
2018-11-30T15:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T17:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T19:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T21:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-11-30T23:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T01:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T03:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T05:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T07:02:04.241+0100 INFO [myScheduler-6] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T09:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T11:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T13:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T15:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T17:02:04.241+0100 INFO [myScheduler-8] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T19:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T21:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-01T23:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T01:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T03:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T05:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T07:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T09:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T09:12:39.870+0100 WARN [myScheduler-5] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:442 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py]: Non-zero return code: 1\
2018-12-02T09:12:39.871+0100 WARN [myScheduler-5] com.vce.commons.core.services.ScriptServiceImpl ScriptServiceImpl.runLocalScript:446 - [/usr/lib/vmware-marvin/marvind/webapps/ROOT/WEB-INF/classes/scripts/query-vsan-stats.py@localhost]: Traceback (most recent call last):\
File "/usr/lib/vmware-marvin/marvind/temp/3111910519293950017.tmp", line 87, in \
main()\
File "/usr/lib/vmware-marvin/marvind/temp/3111910519293950017.tmp", line 65, in main\
service_instance = connect.Connect(host=options.vc_address, user=options.vc_username, pwd=options.vc_password, version=VIM_VERSION)\
File "/usr/lib/python2.7/site-packages/pyVim/connect.py", line 242, in Connect\
File "/usr/lib/python2.7/site-packages/pyVim/connect.py", line 340, in __Login\
File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 557, in \
File "/usr/lib/python2.7/site-packages/pyVmomi/VmomiSupport.py", line 363, in _InvokeMethod\
File "/usr/lib/python2.7/site-packages/pyVmomi/SoapAdapter.py", line 1335, in InvokeMethod\
pyVmomi.VmomiSupport.InvalidLogin: (vim.fault.InvalidLogin) \{\
dynamicType = ,\
dynamicProperty = (vmodl.DynamicProperty) [],\
msg = 'Cannot complete login due to an incorrect user name or password.',\
faultCause = ,\
faultMessage = (vmodl.LocalizableMessage) []\
\}\
\
2018-12-02T11:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T13:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T15:02:04.241+0100 INFO [myScheduler-1] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T17:02:04.241+0100 INFO [myScheduler-10] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T19:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T21:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-02T23:02:04.241+0100 INFO [myScheduler-4] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T01:02:04.241+0100 INFO [myScheduler-5] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T03:02:04.241+0100 INFO [myScheduler-9] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T05:02:04.241+0100 INFO [myScheduler-7] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T07:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T09:02:04.241+0100 INFO [myScheduler-3] com.vce.commons.core.services.VCConnectionServiceImpl VCConnectionServiceImpl.flushOldVCConnection:120 - Clean up old VC connection.\
2018-12-03T09:31:33.092+0100 INFO [tomcat-http--21] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-12-03T09:31:41.986+0100 INFO [tomcat-http--21] com.vce.commons.core.connection.misc.ConnectionUtils ConnectionUtils.getSsoUrl:124 - Trying to obtain sso token from: https://172.16.0.21/sts/STSService/vsphere.local\
2018-12-03T09:31:44.273+0100 INFO [tomcat-http--21] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:123 - Trying to find role: VMware HCIA Management in VC: 172.16.0.22\
2018-12-03T09:31:44.310+0100 INFO [tomcat-http--21] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:126 - Retrieved role list from VC.\
2018-12-03T09:31:44.310+0100 INFO [tomcat-http--21] com.vce.commons.core.services.ops.VCEntityService VCEntityService.findRoleIdByName:129 - Found matched role id: -1532234797\
}
Bill_Leslie
56 Posts
1
December 4th, 2018 12:00
At this point, you should open a ticket so support can get involved. This forum is publicly viewable and does not replace proper support involvement.