When we install MS updates we have the server set to automatically reboot. Everytime after this reboot when we come in then next morning we are getting…
HTTP ERROR: 503
Problem accessing /qcbin/ .Reason:
Service Unavailable
We then have to restart the ALM service to get the ALM service back up and running.
When we look in the wrapper.log we find the following…
INFO | jvm 1 | 2016/05/22 05:20:17.274 | Reading configuration from url file:/C:/ProgramData/HP/ALM/webapps/qcbin/WEB-INF/siteadmin.xml
INFO | jvm 1 | 2016/05/22 05:20:22.326 |
INFO | jvm 1 | 2016/05/22 05:20:22.326 | /**
INFO | jvm 1 | 2016/05/22 05:20:22.326 | 2016-05-22 05:20 WrapperSimpleAppMain ERR com.hp.alm.platform.db.CConnectionManager Can’t create a new database connection for url ‘jdbc:mercury:sqlserver://:1433′ on setting catalog to ‘qcsiteadmin_db’
INFO | jvm 1 | 2016/05/22 05:20:22.326 | null
INFO | jvm 1 | 2016/05/22 05:20:22.326 | [Mercury][SQLServer JDBC Driver][SQLServer]Database ‘qcsiteadmin_db’ is being recovered. Waiting until recovery is finished.
INFO | jvm 1 | 2016/05/22 05:20:22.326 | **/
INFO | jvm 1 | 2016/05/22 05:20:22.428 |
INFO | jvm 1 | 2016/05/22 05:20:22.428 | /**
INFO | jvm 1 | 2016/05/22 05:20:22.428 | 2016-05-22 05:20 WrapperSimpleAppMain ERR com.mercury.optane.core.state.ServerStatusTracker status=MUTED, label=QC server is muted due to unrecoverable error, reason=Failed to obtain a connection to schema ‘qcsiteadmin_db’; com.hp.alm.platform.db.CTdDbException: Can’t create a new database connection.,
INFO | jvm 1 | 2016/05/22 05:20:22.428 | StackTrace=
INFO | jvm 1 | 2016/05/22 05:20:22.428 | com.hp.alm.platform.db.CTdDbException: Can’t create a new database connection.
It looks like ALM started before the SQL service finished starting, but how do we fix this?