Seeing the following entries in the service_manager.log. What could be causing this behaviour?
2019-11-29 07:35:30,304 [KafkaTransactionLogService-process-design-REPLICA STARTING] INFO com.appian.komodo.log.KafkaTransactionLogService - Starting KafkaTransactionLogService-process-design-REPLICA 2019-11-29 07:35:30,308 [KafkaTransactionLogService-process-design-REPLICA STARTING] INFO com.appian.komodo.util.kafka.TopicManager - Topic serviceManager.transaction.process-design available. 2019-11-29 07:35:30,313 [KafkaTransactionLogService-process-design-REPLICA STARTING] WARN com.appian.komodo.util.kafka.SingleTopicPartitionConsumer - Unexpected OffsetOutOfRangeException for serviceManager.transaction.process-design-0 org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {serviceManager.transaction.process-design-0=4446903} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:883) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:528) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1178) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1111) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at com.appian.komodo.util.kafka.SingleTopicPartitionConsumer.poll(SingleTopicPartitionConsumer.java:179) ~[kafka-util-1.205.0.jar:1.205.0] at com.appian.komodo.util.kafka.SingleTopicPartitionConsumer.pollIndefinitely(SingleTopicPartitionConsumer.java:160) ~[kafka-util-1.205.0.jar:1.205.0] at com.appian.komodo.log.CalculateState.apply(CalculateState.java:62) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.calculateState(KafkaTransactionLogService.java:155) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.calculateState(KafkaTransactionLogService.java:142) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.initialize(KafkaTransactionLogService.java:131) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.startUp(KafkaTransactionLogService.java:392) ~[core-1.205.0.jar:1.205.0] at com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60) ~[guava-19.0.jar:?] at com.google.common.util.concurrent.Callables$3.run(Callables.java:100) ~[guava-19.0.jar:?] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222] 2019-11-29 07:35:30,315 [engine-supervisor-process-design-0] ERROR com.appian.komodo.engine.EngineSupervisor - Engine component creation for process-design has failed. java.util.concurrent.CompletionException: java.lang.IllegalStateException: Expected the service to be RUNNING, but the service has FAILED at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_222] at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_222] at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592) ~[?:1.8.0_222] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_222] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_222] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222] Caused by: java.lang.IllegalStateException: Expected the service to be RUNNING, but the service has FAILED at com.google.common.util.concurrent.AbstractService.checkCurrentState(AbstractService.java:310) ~[guava-19.0.jar:?] at com.google.common.util.concurrent.AbstractService.awaitRunning(AbstractService.java:255) ~[guava-19.0.jar:?] at com.google.common.util.concurrent.AbstractIdleService.awaitRunning(AbstractIdleService.java:159) ~[guava-19.0.jar:?] at com.appian.komodo.engine.EngineComponent.initialize(EngineComponent.java:143) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.engine.EngineSupervisor.lambda$startEngineComponent$0(EngineSupervisor.java:175) ~[core-1.205.0.jar:1.205.0] at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590) ~[?:1.8.0_222] ... 3 more Caused by: org.apache.kafka.clients.consumer.OffsetOutOfRangeException: Offsets out of range with no configured reset policy for partitions: {serviceManager.transaction.process-design-0=4446903} at org.apache.kafka.clients.consumer.internals.Fetcher.parseCompletedFetch(Fetcher.java:883) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.internals.Fetcher.fetchedRecords(Fetcher.java:528) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.KafkaConsumer.pollOnce(KafkaConsumer.java:1178) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1111) ~[kafka-clients-1.0.1-appian-33daaceb.jar:?] at com.appian.komodo.util.kafka.SingleTopicPartitionConsumer.poll(SingleTopicPartitionConsumer.java:179) ~[kafka-util-1.205.0.jar:1.205.0] at com.appian.komodo.util.kafka.SingleTopicPartitionConsumer.pollIndefinitely(SingleTopicPartitionConsumer.java:160) ~[kafka-util-1.205.0.jar:1.205.0] at com.appian.komodo.log.CalculateState.apply(CalculateState.java:62) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.calculateState(KafkaTransactionLogService.java:155) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.calculateState(KafkaTransactionLogService.java:142) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.initialize(KafkaTransactionLogService.java:131) ~[core-1.205.0.jar:1.205.0] at com.appian.komodo.log.KafkaTransactionLogService.startUp(KafkaTransactionLogService.java:392) ~[core-1.205.0.jar:1.205.0] at com.google.common.util.concurrent.AbstractIdleService$DelegateService$1.run(AbstractIdleService.java:60) ~[guava-19.0.jar:?] at com.google.common.util.concurrent.Callables$3.run(Callables.java:100) ~[guava-19.0.jar:?] ... 1 more 2019-11-29 07:35:30,315 [KomodoEventBus-149] INFO com.appian.komodo.engine.status.EngineStatusMonitor - process-design is now STOPPING (due to StartEngineFailedEvent{createdInstant=2019-11-29T07:35:30.315Z, engineId=process-design})
Discussion posts and replies are publicly visible
Fixed the issue by resetting offset in Zookeeper.
https://gist.github.com/marwei/cd40657c481f94ebe273ecc16601674b