Bug: Kafka starting issue causing Mimir startup to fail

What is the bug?

Kafka is not starting up causing the entire Mimir stack to fail.

How to reproduce it?

1. Install the Kafka Stack.
2. After 24hrs this happens when Infras are shutdown and started again

What did you think would happen?

1. It happens everyday after the AKS is restarted.

What was your environment?

Kubernetes: Azure Kubernetes Service v1.32.6 Mimir Chart Version: 6.1.0-weekly.378

Any additional context to share?

Logs:

===> User uid=1001 gid=1001 groups=1001 ===> Setting default values of environment variables if not already set. CLUSTER_ID not set. Setting it to default value: "5L6g3nShT-eMCtK--X86sw" ===> Configuring ... Running in KRaft mode... ===> Launching ... Log directory /var/lib/kafka/data is already formatted. Use --ignore-formatted to ignore this directory and format the others. WARNING: THIS IS AN EXPERIMENTAL DOCKER IMAGE RECOMMENDED FOR LOCAL TESTING AND DEVELOPMENT PURPOSES. 2026-01-30T06:16:56.746034Z main ERROR Unable to create file /opt/kafka/logs//server.log java.io.IOException: Could not create directory /opt/kafka/logs at org.apache.logging.log4j.core.util.FileUtils.mkdir(FileUtils.java:129) at org.apache.logging.log4j.core.util.FileUtils.makeParentDirs(FileUtils.java:143) at org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory.createManager(RollingFileManager.java:863) at org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory.createManager(RollingFileManager.java:844) at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:146) at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:112) at org.apache.logging.log4j.core.appender.rolling.RollingFileManager.getFileManager(RollingFileManager.java:307) at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:144) at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:65) at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:124) at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1180) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1099) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1091) at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:695) at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:270) at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:319) at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:673) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:762) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:784) at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:300) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:46) at org.apache.logging.log4j.LogManager.getContext(LogManager.java:138) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:136) at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:58) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46) at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:32) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363) at com.typesafe.scalalogging.Logger$.apply(Logger.scala:31) at kafka.utils.Log4jControllerRegistration$.(Logging.scala:25) at kafka.docker.KafkaDockerWrapper$.(KafkaDockerWrapper.scala:37) at kafka.docker.KafkaDockerWrapper.main(KafkaDockerWrapper.scala) at java.base@21.0.2/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)

2026-01-30T06:16:56.746327Z main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingFileAppender for element RollingFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@73e8c1af] unable to create manager for [/opt/kafka/logs//server.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@63d3ebe4[pattern=/opt/kafka/logs//server.log.%d{yyyy-MM-dd-HH}, append=true, bufferedIO=true, bufferSize=8192, policy=TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d] %p %m (%c)%n, filePermissions=null, fileOwner=null]] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$RollingFileManagerFactory@73e8c1af] unable to create manager for [/opt/kafka/logs//server.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingFileManager$FactoryData@63d3ebe4[pattern=/opt/kafka/logs//server.log.%d{yyyy-MM-dd-HH}, append=true, bufferedIO=true, bufferSize=8192, policy=TimeBasedTriggeringPolicy(nextRolloverMillis=0, interval=1, modulate=true), strategy=DefaultRolloverStrategy(min=1, max=7, useMax=true), advertiseURI=null, layout=[%d] %p %m (%c)%n, filePermissions=null, fileOwner=null]] at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:148) at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:112) at org.apache.logging.log4j.core.appender.rolling.RollingFileManager.getFileManager(RollingFileManager.java:307) at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:144) at org.apache.logging.log4j.core.appender.RollingFileAppender$Builder.build(RollingFileAppender.java:65) at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:124) at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1180) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1099) at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1091) at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:695) at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:270) at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:319) at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:673) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:762) at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:784) at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:300) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:153) at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:46) at org.apache.logging.log4j.LogManager.getContext(LogManager.java:138) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:136) at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:58) at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:46) at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:32) at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363) at com.typesafe.scalalogging.Logger$.apply(Logger.scala:31) at kafka.utils.Log4jControllerRegistration$.(Logging.scala:25) at kafka.docker.KafkaDockerWrapper$.(KafkaDockerWrapper.scala:37) at kafka.docker.KafkaDockerWrapper.main(KafkaDockerWrapper.scala) at java.base@21.0.2/java.lang.invoke.LambdaForm$DMH/sa346b79c.invokeStaticInit(LambdaForm$DMH)