Unable to restart 17.3

Ie updated our 17.2 install too 17.3 and yesterday started the services and was happy to report everything worked.

However this morning I was unable to login to the server and was getting a username / password invalid error. I checked and all other users were getting the same.

I have stopped Appian (JBOSS --> Search Engines --> Services) and restarted server.

 

Now when I retry to start Appian, using start.bat -p passwoard -s all I'm not having much success. I can see the services looping during startup, and some do status change. However I get the following message : 

notifications-email in DOWN state, REPLICA mode
Error running script: Failed to start the following engines: [execution00, execu
tion01, execution02, notifications, notifications-email, process-design]

The following 9 services are running [analytics00, analytics01, analytics02, cha
nnels, content, download-stats, forums, groups, portal]

The following 6 services failed to start [execution00, execution01, execution02,
notifications, notifications-email, process-design]

 

If I look in the Appian Log I can see the following message for the execution nodes :

 

2017-10-06 12:38:14,363 [KomodoEventBus-112] ERROR com.appian.komodo.engine.status.ReplayStateProvider - Error replaying transactions for execution01: TransactionReplayFailedEvent{createdInstant=2017-10-06T12:38:14.363Z, engineId=execution01, startTransactionId=Optional[1251556], transactionsReplayedCount=0, cause=com.appian.komodo.translog.TransactionNotFoundException}, caused by:
com.appian.komodo.translog.TransactionNotFoundException
at com.appian.komodo.log.KafkaTransactionLogService.getTransactionLogEntryIterator(KafkaTransactionLogService.java:372) ~[core-1.69.3.jar:1.69.3]
at com.appian.komodo.log.KafkaTransactionLogService.getAllTransactionsStartingFrom(KafkaTransactionLogService.java:362) ~[core-1.69.3.jar:1.69.3]
at com.appian.komodo.translog.TransactionReplayer.doReplay(TransactionReplayer.java:101) ~[core-1.69.3.jar:1.69.3]
at com.appian.komodo.translog.TransactionReplayer.replayIfNeeded(TransactionReplayer.java:77) ~[core-1.69.3.jar:1.69.3]
at com.appian.komodo.translog.TransactionReplayer.onEngineConnect(TransactionReplayer.java:61) ~[core-1.69.3.jar:1.69.3]
at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[?:1.8.0_102]
at java.lang.reflect.Method.invoke(Unknown Source) ~[?:1.8.0_102]
at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:95) ~[guava-19.0.jar:1.69.3]
at com.google.common.eventbus.Subscriber$SynchronizedSubscriber.invokeSubscriberMethod(Subscriber.java:154) ~[guava-19.0.jar:1.69.3]
at com.google.common.eventbus.Subscriber$1.run(Subscriber.java:80) ~[guava-19.0.jar:1.69.3]
at com.google.common.util.concurrent.MoreExecutors$DirectExecutor.execute(MoreExecutors.java:456) ~[guava-19.0.jar:?]
at com.google.common.eventbus.Subscriber.dispatchEvent(Subscriber.java:76) ~[guava-19.0.jar:1.69.3]
at com.google.common.eventbus.SubscriberOrderedAsyncEventBus$EventAndSubscriber.directlyDispatchNextEvent(SubscriberOrderedAsyncEventBus.java:168) ~[core-1.69.3.jar:1.69.3]
at com.google.common.eventbus.SubscriberOrderedAsyncEventBus$PerTargetQueuedDispatcher.lambda$createWorker$2(SubscriberOrderedAsyncEventBus.java:119) ~[core-1.69.3.jar:1.69.3]
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176) ~[metrics-core-3.1.2.jar:3.1.2]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [?:1.8.0_102]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [?:1.8.0_102]
at java.lang.Thread.run(Unknown Source) [?:1.8.0_102]

  Discussion posts and replies are publicly visible