Hi All,
I am not able start data server .not seeing any errors also., Does any one faced similar issue?
0 [main] INFO com.appian.data.TopologyFactory - Loading topology /apps/appian/data-server/conf/appian-topology.xml282 [main] INFO com.appian.data.server.config.CustomPropertiesConfiguration - Configuration file custom.properties does not exist. Default settings will be used.298 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/data'302 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/data'302 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/node'302 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/node'302 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-server'302 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-server'302 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-metrics'302 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-metrics'305 [main] INFO com.appian.data.server.Watchdog - Initializing log4j (processName=watchdog, logsDir=/apps/appian/data-server/../logs/data-server) from /apps/appian/data-server/conf/log4j.properties{"level":"INFO","time":"2019-06-29T10:56:00.299Z","logger":"watchdog","caller":"Watchdog.java:1099","thread":"main","msg":"Starting Data Server in the background"}{"level":"INFO","time":"2019-06-29T10:56:00.302Z","logger":"watchdog","caller":"JvmStarter.java:41","thread":"main","msg":"Starting JVM process: Config{class=com.appian.data.server.Watchdog, hostAndPort=localhost:5400, args=[-f]}"}
Thanks,
Sushma
Discussion posts and replies are publicly visible
0 [main] INFO com.appian.data.TopologyFactory - Loading topology /apps/appian/data-server/conf/appian-topology.xml308 [main] INFO com.appian.data.server.config.CustomPropertiesConfiguration - Configuration file custom.properties does not exist. Default settings will be used.324 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/data'327 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/data'328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/node'328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/node'328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-server'328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-server'328 [main] INFO com.appian.data.server.Watchdog - Creating directory '/apps/appian/data-server/../logs/data-metrics'328 [main] INFO com.appian.data.server.Watchdog - Checking permissions on directory '/apps/appian/data-server/../logs/data-metrics'330 [main] INFO com.appian.data.server.Watchdog - Initializing log4j (processName=watchdog, logsDir=/apps/appian/data-server/../logs/data-server) from /apps/appian/data-server/conf/log4j.properties{"level":"INFO","time":"2019-06-29T11:26:41.328Z","logger":"watchdog","caller":"Watchdog.java:1047","thread":"main","msg":"Starting Data Server. Build-Version[0.133.7], Build-Date[2019-05-06], Target-Version[2019-04-03]"}{"level":"INFO","time":"2019-06-29T11:26:41.837Z","logger":"watchdog","caller":"Logging.java:53","thread":"main","msg":"Total memory: 87031808, Max memory: 119537664, Free memory: 73441616, Num processors: 4"}{"level":"INFO","time":"2019-06-29T11:26:41.838Z","logger":"watchdog","caller":"Logging.java:56","thread":"main","msg":"JVM version: 1.8.0_212, JVM arguments: -Duser.timezone=GMT -Xms64m -Xmx128m -Dds.home=/apps/appian/data-server, JVM current dir: /apps/appian/data-server/bin"}{"level":"INFO","time":"2019-06-29T11:26:41.957Z","logger":"watchdog","caller":"VertxServer.java:105","thread":"vert.x-eventloop-thread-1","msg":"Listening on localhost:5400..."}{"level":"INFO","time":"2019-06-29T11:26:41.961Z","logger":"watchdog","caller":"VertxServer.java:105","thread":"vert.x-eventloop-thread-3","msg":"Listening on localhost:6400..."}{"level":"INFO","time":"2019-06-29T11:26:42.372Z","logger":"watchdog","caller":"MigrationEngine.java:105","thread":"main","msg":"Version on disk (2019-04-03) is verified. No migration required..."}{"level":"INFO","time":"2019-06-29T11:26:42.377Z","logger":"watchdog","caller":"TopicManager.java:181","thread":"main","msg":"Topic ds_txEffects already exists"}{"level":"INFO","time":"2019-06-29T11:26:42.378Z","logger":"watchdog","caller":"TopicManager.java:281","thread":"main","msg":"Ensuring topic "ds_txEffects" has the correct configuration"}{"level":"INFO","time":"2019-06-29T11:26:42.486Z","logger":"watchdog","caller":"TopicManager.java:298","thread":"main","msg":"Topic "ds_txEffects" has the correct configuration"}{"level":"INFO","time":"2019-06-29T11:26:42.486Z","logger":"watchdog","caller":"TopicManager.java:168","thread":"main","msg":"Active brokers: [localhost:9092 (id: 0 rack: null)]"}{"level":"INFO","time":"2019-06-29T11:26:42.490Z","logger":"watchdog","caller":"TopicManager.java:342","thread":"main","msg":"Topic ds_txEffects has desired assigned replicas: [localhost:9092 (id: 0 rack: null)]"}{"level":"INFO","time":"2019-06-29T11:27:12.522Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'appender'"}{"level":"INFO","time":"2019-06-29T11:27:12.554Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'hs'"}{"level":"INFO","time":"2019-06-29T11:27:12.556Z","logger":"watchdog","caller":"AppenderStarter.java:39","thread":"process-starter-0","msg":"Starting appender engine (port=5405)..."}{"level":"INFO","time":"2019-06-29T11:27:12.557Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-0","msg":"Starting Q process: Config{script=appender.q, hostAndPort=localhost:5405, args=[]}"}{"level":"INFO","time":"2019-06-29T11:27:12.592Z","logger":"watchdog","caller":"ScriptUtils.java:64","thread":"main","msg":"Killing data server component 'rts:0'"}{"level":"INFO","time":"2019-06-29T11:27:12.599Z","logger":"watchdog","caller":"HistoricalStoreStarter.java:38","thread":"process-starter-1","msg":"Starting HS engine (port=5403)..."}{"level":"INFO","time":"2019-06-29T11:27:12.600Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-1","msg":"Starting Q process: Config{script=hs.q, hostAndPort=localhost:5403, args=[]}"}{"level":"INFO","time":"2019-06-29T11:27:12.623Z","logger":"watchdog","caller":"RealtimeStoreStarter.java:40","thread":"process-starter-2","msg":"Starting RTS-0 engine (port=5451)..."}{"level":"INFO","time":"2019-06-29T11:27:12.624Z","logger":"watchdog","caller":"QStarter.java:53","thread":"process-starter-2","msg":"Starting Q process: Config{script=rts.q, hostAndPort=localhost:5451, args=[-rts, 0]}"}
Are you referring to this error?
{"level":"ERROR","time":"2019-06-29T14:21:39.435Z","logger":"watchdog","caller":"Watchdog.java:1172","thread":"main","msg":"Shutting down with exit code 1..."} com.appian.data.server.UnrecoverableError: Lost WebSocket connection with localhost:5400. The target JVM process exited abnormally. Check for earlier errors (e.g. JVM startup errors). at com.appian.data.server.HeartbeatListener$SyncHeartbeatListenerBuilder.create(HeartbeatListener.java:165) at com.appian.data.server.JvmStarter.startSync(JvmStarter.java:37) at com.appian.data.server.Watchdog.startWatchdogDaemon(Watchdog.java:1100) at com.appian.data.server.Watchdog.main(Watchdog.java:1156) Caused by: java.lang.Exception: WebSocket closed. at com.appian.data.server.HeartbeatListener$HeartbeatListenerFuture.lambda$null$1(HeartbeatListener.java:212) at io.vertx.core.http.impl.WebSocketImplBase.handleClosed(WebSocketImplBase.java:198) at io.vertx.core.http.impl.WebSocketImpl.handleClosed(WebSocketImpl.java:163) at io.vertx.core.http.impl.ClientConnection.handleClosed(ClientConnection.java:394) at io.vertx.core.impl.ContextImpl.lambda$wrapTask$2(ContextImpl.java:314) at io.vertx.core.impl.ContextImpl.executeFromIO(ContextImpl.java:190) at io.vertx.core.net.impl.VertxHandler.channelInactive(VertxHandler.java:97) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:234) at io.netty.handler.codec.ByteToMessageDecoder.channelInputClosed(ByteToMessageDecoder.java:360) at io.netty.handler.codec.ByteToMessageDecoder.channelInactive(ByteToMessageDecoder.java:325) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.AbstractChannelHandlerContext.fireChannelInactive(AbstractChannelHandlerContext.java:234) at io.netty.channel.DefaultChannelPipeline$HeadContext.channelInactive(DefaultChannelPipeline.java:1329) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:255) at io.netty.channel.AbstractChannelHandlerContext.invokeChannelInactive(AbstractChannelHandlerContext.java:241) at io.netty.channel.DefaultChannelPipeline.fireChannelInactive(DefaultChannelPipeline.java:908) at io.netty.channel.AbstractChannel$AbstractUnsafe$7.run(AbstractChannel.java:744) at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:163) at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:418) at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:440) at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873) at java.lang.Thread.run(Thread.java:748)
Hi Sushma,
It seems that data-server folder is not configured properly.check if custom.properties file exists in data-server /conf folder. Also ensure if appian-topology.xml file is copied from <APPIAN_HOME>/conf/ into <APPIAN_HOME>/data-server/conf/ before starting the data server.
appian-topology.xml
<APPIAN_HOME>/conf/
<APPIAN_HOME>/data-server/conf/
Hope it helps!!
After enabling debug in log4j..
I could see below logs at watchdog.log.
{"level":"DEBUG","time":"2019-06-29T18:09:23.075Z","logger":"watchdog","caller":"ClientCnxn.java:745","thread":"main-SendThread(localhost:2181)","msg":"Got ping response for sessionid: 0x10004d63cc5000d after 0ms"}
{"level":"DEBUG","time":"2019-06-29T18:09:28.992Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-0","msg":"Failed to fetch the status from localhost:5401"}
io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5401
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:347)
at io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:340)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:627)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:551)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:465)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:437)
at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:873)
at java.lang.Thread.run(Thread.java:748)
{"level":"DEBUG","time":"2019-06-29T18:09:28.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-2","msg":"Failed to fetch the status from localhost:5404"}
io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5404
{"level":"DEBUG","time":"2019-06-29T18:09:28.997Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-1","msg":"Failed to fetch the status from localhost:5450"}
io.netty.channel.AbstractChannel$AnnotatedConnectException: Connection refused: localhost/127.0.0.1:5450
{"level":"DEBUG","time":"2019-06-29T18:09:33.083Z","logger":"watchdog","caller":"ClientCnxn.java:745","thread":"main-SendThread(localhost:2181)","msg":"Got ping response for sessionid: 0x10004d63cc5000d after 0ms"}
{"level":"DEBUG","time":"2019-06-29T18:09:38.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-2","msg":"Failed to fetch the status from localhost:5404"}
{"level":"DEBUG","time":"2019-06-29T18:09:38.993Z","logger":"watchdog","caller":"StatusHandler.java:58","thread":"vert.x-eventloop-thread-1","msg":"Failed to fetch the status from localhost:5450"}
Errors are similar to KB articles
https://community.appian.com/support/w/kb/1383/kb-1890-data-server-does-not-start-with-could-not-establish-websocket-connection-with-host_5f00_and_5f00_post
but i don't see any restrictions at VM level for these ports . [5401, 5404 ,5450]
if any restrictions how does other ports 5403 5405 5400 are started. which is used by Data server.
Any clue to resolve these issue VM.
sushma
I simply redid the installation and it solved my issue.
I did the reinstall, but it did not resolved my issue.
is this issue resolved ?