unable start data server in ubuntu : 19.2 Hotfix A

unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/discussions/f/administration/17192/unable-start-data-server-in-ubuntu-19-2-hotfix-aHi All, I am not able start data server .not seeing any errors also., Does any one faced similar issue? 0 [main] INFO com.appian.data.TopologyFactory - Loading topology /apps/appian/data-server/conf/appian-topology.xml 282 [main] INFO com.appian.dataen-USTelligent Community 12RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/70616?ContentTypeID=1Fri, 22 Nov 2019 04:48:15 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:2af87dad-2d64-4a31-b7c0-78cc77e35b9fmanjunathrc<p>is this issue resolved ?</p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67816?ContentTypeID=1Mon, 01 Jul 2019 17:54:30 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:4fd63214-fbad-4c45-b23d-8788c1d05ecesushmab84<p>I did the reinstall, but it did not resolved my issue.</p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67789?ContentTypeID=1Sun, 30 Jun 2019 18:57:45 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:18b7e0ec-fcc1-43a1-81e8-cbde39a11284Mathieu Drouin<p>I simply redid the installation and it solved my issue.</p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67788?ContentTypeID=1Sun, 30 Jun 2019 09:50:43 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:c4bdc921-65a4-4ddc-afd1-90d1027de900sushmab84<p>Hi All,</p> <p></p> <p>After enabling debug in log4j.. </p> <p></p> <p>I could see below logs at watchdog.log. </p> <p></p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:23.075Z","logger":"watchdog","caller":"ClientCnxn.java:745","thread":"main-SendThread(localhost:2181)","msg":"Got ping response for sessionid: 0x10004d63cc5000d after 0ms"}</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:28.992Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-0","msg":"Failed to fetch the status from localhost:5401"}</p> <p>io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5401</p> <p>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)</p> <p>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)</p> <p>        at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)</p> <p>        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)</p> <p>        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)</p> <p>        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)</p> <p>        at java.lang.Thread.run(Thread.java:748)</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:28.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-2","msg":"Failed to fetch the status from localhost:5404"}</p> <p>io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5404</p> <p>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)</p> <p>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)</p> <p>        at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)</p> <p>        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)</p> <p>        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)</p> <p>        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)</p> <p>        at java.lang.Thread.run(Thread.java:748)</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:28.997Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-1","msg":"Failed to fetch the status from localhost:5450"}</p> <p>io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5450</p> <p>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)</p> <p>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)</p> <p>        at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)</p> <p>        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)</p> <p>        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)</p> <p>        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)</p> <p>        at java.lang.Thread.run(Thread.java:748)</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:33.083Z","logger":"watchdog","caller":"ClientCnxn.java:745","thread":"main-SendThread(localhost:2181)","msg":"Got ping response for sessionid: 0x10004d63cc5000d after 0ms"}</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:38.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-2","msg":"Failed to fetch the status from localhost:5404"}</p> <p>io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5404</p> <p>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)</p> <p>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)</p> <p>        at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)</p> <p>        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)</p> <p>        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)</p> <p>        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)</p> <p>        at java.lang.Thread.run(Thread.java:748)</p> <p>{"level":"DEBUG","time":"2019-06-29T18:09:38.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-1","msg":"Failed to fetch the status from localhost:5450"}</p> <p>io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5450</p> <p>        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)</p> <p>        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)</p> <p>       at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)</p> <p>        at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)</p> <p>        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)</p> <p>        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)</p> <p>        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)</p> <p>        at java.lang.Thread.run(Thread.java:748)</p> <p></p> <p></p> <p>Errors are similar to KB articles</p> <p></p> <p><a href="/support/w/kb/1383/kb-1890-data-server-does-not-start-with-could-not-establish-websocket-connection-with-host_5f00_and_5f00_post">https://community.appian.com/support/w/kb/1383/kb-1890-data-server-does-not-start-with-could-not-establish-websocket-connection-with-host_5f00_and_5f00_post</a></p> <p>but i don't see any restrictions at VM level for these ports . [5401, 5404 ,5450]</p> <p>if any restrictions how does other ports  5403 5405 5400 are started. which is used by Data server.</p> <p>Any clue to resolve these issue VM.</p> <p></p> <p>Thanks,</p> <p>sushma</p> <p></p> <p> </p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67786?ContentTypeID=1Sat, 29 Jun 2019 20:52:00 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:53cd3a17-911d-4a73-9bb1-fdf250b46401PRATEEK BHATTI<p>Hi Sushma,</p> <p>It seems that data-server folder is not configured properly.<br />check if custom.properties file exists in data-server /conf folder. Also ensure if<span> </span><code class="highlighter-rouge">appian-topology.xml</code><span> file is copied from </span><code class="highlighter-rouge"><APPIAN_HOME>/conf/</code><span>  into  </span><code class="highlighter-rouge"><APPIAN_HOME>/data-server/conf/</code><span> before starting the data server.</span></p> <p><span>Hope it helps!!</span></p> <p><span></span></p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67784?ContentTypeID=1Sat, 29 Jun 2019 14:26:29 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:6ad6768a-001d-41e5-a61c-6d0f26595f66Mathieu Drouin<p>Are you referring to this error?</p> <p><pre class="ui-code" data-mode="text">{"level":"ERROR","time":"2019-06-29T14:21:39.435Z","logger":"watchdog","caller":"Watchdog.java:1172","thread":"main","msg":"Shutting down with exit code 1..."} com.appian.data.server.UnrecoverableError: Lost WebSocket connection with localhost:5400. The target JVM process exited abnormally. Check for earlier errors (e.g. JVM startup errors). at com.appian.data.server.HeartbeatListener$SyncHeartbeatListenerBuilder.create(HeartbeatListener.java:165) at com.appian.data.server.JvmStarter.startSync(JvmStarter.java:37) at com.appian.data.server.Watchdog.startWatchdogDaemon(Watchdog.java:1100) at com.appian.data.server.Watchdog.main(Watchdog.java:1156) Caused by: java.lang.Exception: WebSocket closed. at com.appian.data.server.HeartbeatListener$HeartbeatListenerFuture.lambda$null$1(HeartbeatListener.java:212) at io.vertx.core.http.impl.WebSocketImplBase.handleClosed(WebSocketImplBase.java:198) at io.vertx.core.http.impl.WebSocketImpl.handleClosed(WebSocketImpl.java:163) at io.vertx.core.http.impl.ClientConnection.handleClosed(ClientConnection.java:394) at io.vertx.core.impl.ContextImpl.lambda$wrapTask$2(ContextImpl.java:314) at io.vertx.core.impl.ContextImpl.executeFromIO(ContextImpl.java:190) at io.vertx.core.net.impl.VertxHandler.channelInactive(VertxHandler.java:97) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:234) at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:360) at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:325) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:234) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1329) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:908) at io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:744) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:418) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:440) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873) at java.lang.Thread.run(Thread.java:748) </pre></p><div style="clear:both;"></div>RE: unable start data server in ubuntu : 19.2 Hotfix Ahttps://community.appian.com/thread/67783?ContentTypeID=1Sat, 29 Jun 2019 11:58:30 GMTd3a83456-d57b-489c-a84c-4e8267bb592a:fe15c78e-b4e4-42d9-99c9-ee157be97ceasushmab84<p>0 [main] INFO com.appian.data.TopologyFactory - Loading topology /apps/appian/data-server/conf/appian-topology.xml<br />308 [main] INFO com.appian.data.server.config.CustomPropertiesConfiguration - Configuration file custom.properties does not exist. Default settings will be used.<br />324 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/data'<br />327 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/data'<br />328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/node'<br />328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/node'<br />328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-server'<br />328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-server'<br />328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-metrics'<br />328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-metrics'<br />330 [main] INFO com.appian.data.server.Watchdog - Initializing log4j (processName=watchdog, logsDir=/apps/appian/data-server/../logs/data-server) from /apps/appian/data-server/conf/log4j.properties<br />{"level":"INFO","time":"2019-06-29T11:26:41.328Z","logger":"watchdog","caller":"Watchdog.java:1047","thread":"main","msg":"Starting Data Server. Build-Version[0.133.7], Build-Date[2019-05-06], Target-Version[2019-04-03]"}<br />{"level":"INFO","time":"2019-06-29T11:26:41.837Z","logger":"watchdog","caller":"Logging.java:53","thread":"main","msg":"Total memory: 87031808, Max memory: 119537664, Free memory: 73441616, Num processors: 4"}<br />{"level":"INFO","time":"2019-06-29T11:26:41.838Z","logger":"watchdog","caller":"Logging.java:56","thread":"main","msg":"JVM version: 1.8.0_212, JVM arguments: -Duser.timezone=GMT -Xms64m -Xmx128m -Dds.home=/apps/appian/data-server, JVM current dir: /apps/appian/data-server/bin"}<br />{"level":"INFO","time":"2019-06-29T11:26:41.957Z","logger":"watchdog","caller":"VertxServer.java:105","thread":"vert.x-eventloop-thread-1","msg":"Listening on localhost:5400..."}<br />{"level":"INFO","time":"2019-06-29T11:26:41.961Z","logger":"watchdog","caller":"VertxServer.java:105","thread":"vert.x-eventloop-thread-3","msg":"Listening on localhost:6400..."}<br />{"level":"INFO","time":"2019-06-29T11:26:42.372Z","logger":"watchdog","caller":"MigrationEngine.java:105","thread":"main","msg":"Version on disk (2019-04-03) is verified. No migration required..."}<br />{"level":"INFO","time":"2019-06-29T11:26:42.377Z","logger":"watchdog","caller":"TopicManager.java:181","thread":"main","msg":"Topic ds_txEffects already exists"}<br />{"level":"INFO","time":"2019-06-29T11:26:42.378Z","logger":"watchdog","caller":"TopicManager.java:281","thread":"main","msg":"Ensuring topic "ds_txEffects" has the correct configuration"}<br />{"level":"INFO","time":"2019-06-29T11:26:42.486Z","logger":"watchdog","caller":"TopicManager.java:298","thread":"main","msg":"Topic "ds_txEffects" has the correct configuration"}<br />{"level":"INFO","time":"2019-06-29T11:26:42.486Z","logger":"watchdog","caller":"TopicManager.java:168","thread":"main","msg":"Active brokers: [localhost:9092 (id: 0 rack: null)]"}<br />{"level":"INFO","time":"2019-06-29T11:26:42.490Z","logger":"watchdog","caller":"TopicManager.java:342","thread":"main","msg":"Topic ds_txEffects has desired assigned replicas: [localhost:9092 (id: 0 rack: null)]"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.522Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'appender'"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.554Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'hs'"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.556Z","logger":"watchdog","caller":"AppenderStarter.java:39","thread":"process-starter-0","msg":"Starting appender engine (port=5405)..."}<br />{"level":"INFO","time":"2019-06-29T11:27:12.557Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-0","msg":"Starting Q process: Config{script=appender.q, hostAndPort=localhost:5405, args=[]}"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.592Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'rts:0'"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.599Z","logger":"watchdog","caller":"HistoricalStoreStarter.java:38","thread":"process-starter-1","msg":"Starting HS engine (port=5403)..."}<br />{"level":"INFO","time":"2019-06-29T11:27:12.600Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-1","msg":"Starting Q process: Config{script=hs.q, hostAndPort=localhost:5403, args=[]}"}<br />{"level":"INFO","time":"2019-06-29T11:27:12.623Z","logger":"watchdog","caller":"RealtimeStoreStarter.java:40","thread":"process-starter-2","msg":"Starting RTS-0 engine (port=5451)..."}<br />{"level":"INFO","time":"2019-06-29T11:27:12.624Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-2","msg":"Starting Q process: Config{script=rts.q, hostAndPort=localhost:5451, args=[-rts, 0]}"}</p><div style="clear:both;"></div>